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EXECUTIVE SUMMARY 

V 

O bject iv e : 

The questions for this study are: *'What role do certificates^ 
licenses^ diplomas and other credentials play in a decentralized 
vocational educatiorf system of public and proprietary sSKcols^^ 
comsiunity colleges^ union apprenticeships^ the military and 
correspondence schools?" and "What role can certification play in 
the CETA system?** V ' ^ . 

Methodology : 

" These questions were explored in interviews with a variety of 
researchers in vocational education and testing and with personnel 
directors from firms^ school directors^ and professional associations. 
A literature review was also conducted on occupational testing^ 
vocational education and work, employmeAt qualifications and licensing^ 
and certification practices. 

Findings : 

Ideally, certificates can be signals of individuals* competence in 
the labor market and a means to clarify the outcomes of training 
programs, in fact^ our research and interviews show certification 
plays a smaller role than it might. Certification schemes are too 
numerous^ too varied and too limited in their information to provide 
a cJlear 6ignal to employers^ students^ instructors or consumets of 
the skills underlying the certificate or the quality of the training 
program behind it. The tests underlying the certificates can be 
questlonable'predictors of good Job performance an^ biased against 
minorities* 

Certification processes need a good deal improvement before they 
can approach their potential usefulness in the labor market. Research 
and development are now being focussed on national^ standardized 
pertif'icates^ on indicators of work habits and basic skills^ tmd on 
unbiased and '^;}ob -^relevant tests and skill records. 

Policy Implication s: 

CE^A should develop a certificate and certification process with 
tb& following features: 

— develop one-page graduate skill records with measures of 
competency in basic skills^ work habits and specialized 
skills and a d5Scription of the training program; 

—require local prime sponsors to use national model skill 
records unless^ they have acceptable substitutes; 



-explore the use of standardized competency tests. Develop 
an inventory of specialized skill tests and support the ^ 
development: of tests or measures of vork habits and generic 
skills; 

*set minitnum national standards for passage of the tests and 
allow the prime sponsor to set higher standards if ^o wished; 

-<«stablish a full-time placement office with e**ch prime sponsor 
and market the standards and tests to employers on a nationwide 
basis. 



SECTION A 

CEHTIFICATES AND TESTS ^- THEIR ROLES 
IN OCCUPATIONAL TRArNING. 

1 . Introduction 

* Many youth and adults go iifto formal postsecondary training each 

year. A 1976 survey 'of the nation's 1972 high school seniors 'shows 

that 3? percent had earned^certificates^ degrees^ licenses or diplomas 

of Some kind. Of these a" good portion were vocational: 1*0 percent earned 

o 

certificates; 15 percent earned licenses; and 9 percent earned 
two*year vo^&tlpnal school diplomas. At the same time, i6 percent 
earned two-year degrees and 37 percent earned bachelir's degrees. While 
over 60 percent had earned no degrees or certificates at that point, many 
of thdse may have been in training pfbgj'ams they did not complete,' 

The postsecondary vocational education system is very diverse and 
decentralized, A student may find a. /five-month program or a twenty*four 
month program for sttnilar occupational specialties. He tnay choose among 
a variety of schools a.id proarams with different teaching approaches: 
public or proprietary proft talking schools, community colleges^ union 
apprenticeships, the military, correspondence schools, government man- 
power training programs, uotmiunity organizations and employee training 
programs. There is "also a myriad of occupational specialties^ from blue^ 
print reader to master craftsman to welder in the trades alone. In any 
iM^tropolitan area^ literally thousands of options'wlll be open to a student 
lobking Vor career training »nd the best match of institutiont ^ost^ 
length of program and occupational' specialty, % 

Coordination among these schools and programs is minimally sought at 

the national or the local level. The resulting system^ with its lack of 

common standards or comprehensive planning^ is strong in several respects. 
It allows for a wide r^nge lof options to develop for the student^ 
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In teaching method, flexibility of ^schedul ing and other characteristics 

of training* Oecentralization also allows the'system to respond 

rapidly to the changing skill needs of regional and local labor markets* ' 

For example, proprietory schools, which ire ^he'^^lT^ree of federal or state 

guidelines, appear to be particularly responsive to .employers * needs a.id ^ 

changing labor mar^ket conditions* Evidence from 3 variety of studies shows that 

thev close and open new programs and improve their equipment more often than 

their public settor counterparts* Hitltary training programs have also 

been innovators In shprt, Intensive courses and In linking Jobs and 

education through explicit task analysts and performance testing. Free* 

dom from the. curriculum constraints of public education systems has 

2 

made thi s possj^le* 

Decentralization and lack of coordination have distinct weaknesses as 
well* Gaps and surplusses In particular fields may develop at the local / 
level when there is^minifna) communication or Incentive to jointly 
plan am^ng institjtions* Dissemination of new Ideas and approaches across 
the System Is unnecessarily slowed by the balkantzatlon-and tack o^^ 
communication among practi tioner^s and researchers* For example, public 
vocational etfucatbrs are generally unaware of the successful innovations In 
the mil ttary sector,* 

Finally, and most Important for this study, the sheer nember and the 
diversity of schools and programs confuse students and employers aljfke* 
Students on their own have limited means to assess the curriculum or the 
payoffs to training from the wide ran9c of programs in the area, and their 
choices are not fully informed* A minority of proprietary schools actively 
engage in misrepresentation and low quality training for non-existent jobs, 
and the FTC and state licensing boards are now dealing with problems of 
this sort by requiring placement Information to be divulged,^ Employers 

.8 
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also find the diversity of programs cpnfuslng. While 'large and well- 
establtshvd schools such as Kathertne GiM>s Secretarial School have a wtde * 
and s^trong reputatlpn» eiT¥>1oyers are unable to distinguish among^ the 
countV.ss programs and schools^ around the country* The net effect is a 
discounting of the value of training and the redaction of Incentives 
for hlgh*qija!tty-tralning on the part of students ,and schools alike* 

The strengths and weaknesses of decentralization create a constant t^nsVon 
between tra need to encourage diversity and responsiveness to local labor 
market needs and Industry's 11 requirements and the need for quatlity 
control and known st^^ndards- in all aspects of vocational training* A 
Similar tension exists tn the specific case of CETA* training programs* 

In this setting^ the questions for this paper 'are: 'Vhat role do 
certificates* licenses^ diplomas and other credentials play In a 
decentralized vocational education systerrf* and 'Vhat role can certifi- 
catlt>n play in the C€TA system?*' These questions were explx)red with a 
variety of researchers in vocational ^education and testing and with personnel 
and training directors from firns» school directors and professional assocla** 
ttons* A literature review was also conducted on occupational testing, 
vocational education and work, employnent qualifications and licensing, 
and certification practices* ' ^ 

Ideally, iiertiflcstes can be a signal of an Individual's conipetence 
tn the labor market and a means to clarify the outcomes of training 
programs* In fact, our research and Interviews show certification plays a 
Smaller role than than tt might* Its effectiveness appears to be limited by 
the very diversity of the system In which it operates* Certification 
schemes are often too numerous, too varied and too limited in their tnforma* 
tlon to provide a clear signal to employers, students, instructors or ^ 

consimers of the skills underlying the certificate or the quality of the 

t * ^ 

9 



\ 



training prqgram behind It* The' tests underlying the certificates can 

be questionable predictors of good Job performance* As a whoU, certify ^ 

Icatton processes need a g»od <}eat of Improvement before they can approach 

their potential useliitness In the labor market* - 

fr 



Functions of Certification ^ 



definitions 



- For the purposes- of this p^per^ a certtfl cate means a record cf the 
competencies of an Individual for employrent* It may be a school diploma^ 
a* license or a portfolio of documented sl;I il^^and'tests of some sort may 
hdve been used to measure the^sktlts shown by the ^ertl fi cate* 

A certification process Includes bpth the steps by which an Individual 
acquires a certificate and the tstandard-setting which establishes skill and 
other requirements to acquire a certlricate* - ^ 



information Signals 

Certificates and certification processes can be used to provide 
the following Information In the inarketplace and training system: 

1} a signaj to an employer of the accomplishments and aptitudes of 
an applicant for a Job or a candidate for promotion; 

2) a signal to th e student of tlie goals he or she must eet In an 
Instructional program or to gain entry Into an occupation; 

3) a signal to Instructors an d administrators of how well an ^.Jucatlonal 
program Is fneeting training standards; and 

k), a signal to consumers of the quaMty of the labor that^ produces goods 
and services. ' 



, ^. *Huch of the Uterature on certtflcatlpa Includes, prily yoluatary xertlflcatei 
in the category, certlfccate. voluntary certificates wTU describea later Jn^bis 

section. * . * 
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Fofc employers ^ the ^ertl f t cate. says the bearer has completed certain 

tasks or met specific standards* At the sltnpllst levels a diploma or degre'e 

\ ^ 

shows that he/she has. the motlvatton and persevererice to enter-and complete 
a vocational 'program and has been exposed to at least soipfe^f the concepts^^d 
demands of tfte occupation." '^f.the certification includes testing, the 
individual's specific skills will also be, m&asured more or less* precisely. ^ 
If the test Is written, certification can ^reveal co^mlttve understanding of * 
the jbb^dndJthe- student*s test-p(c1ng^abU Ity.^ Wtth hands-on performance 
tests^ what the- Individuals "tan do In practice can be closely measured* 

For the en5)loyer, a certificate can be an Important^ If not criti cal > 
component of a hiring or promotion decision on an Indlvtd^'ai* Along with 
personal Interviews and recommendations, certificates denonstratlng school 
attendance or passage of tests can be used to place the Individual In 
the f I rm where ,ht^ competence matches the demands of the Job* As an Informa** 
tlon signal^ the certificate thereby Increases the efficiency of worker alloca- 
tion decision; and specialization In the labor market*^ ' , . 

For the student ^ a certificate can be an Important means to Job advancement 
and a 'Stimulus ^to Investment In sklllst Proof of Job competence or skilly 
gives the Individual an advantage over other applicants In access to high*paylng^ 
Stable Jobs* To tho extent that employers pay attention to txtrtlf Icates, ^students 
have the Incentive to Invest in skills and schooling* Hore students will 
purs4j2 specialized training In greater depths the clearer the signal and the * 
more weight employers attach to It In hiring and promoting* ^ 

While the student Is I-n school, the certification process also presents 
a set of goats. If there are no tests^ It riay only show tvhat attendance record 
Is required to get a certificate* With tests and wl^h courses reflecting 
the occupatlortal requl rerents , the cerTi fl cate <hcws the student the competencies 
that are considered valuable to enter a certain occupation. It alio establishes 

n 
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it^adards of proficiency which must a^t end sets out tasks to be { 
iiiastered by the' S'tudent while tn school. 

For the school , certificatif)n can play a significant role In 
* coordinating and creating incentives for high quality training. Clear 
standards and tests p|pvlde teachers and administrators wfth a conmon 
Set of objectives .for the performance of graduates. As^such» they serve 
as one of seVteral/.mechanisnis for translating Job 'requirements Into ^ 
1 training objectives and programs. Standards pr tests are expensive / 
to 'develop; once known* they provi'de models for all participants in the 
system to follow. The' (Serformance of graduates on standard written tests 
can also provide the means, for evaluating teachers or pro^^»^^ and for 
achieving internal control and accountabt 1 1 ty. 

Fjor thi consumer » certification allows a buyer to see the quarft^t-^ ^ 

of the tabor-^and tSus the quality of the product or service he Is 
purchasing. If all the auto mechanics In a certain ohop are nationally certified 
for their work^ the consumer may think this ts the sign of a good product. 
Certification can also^be used as a sign that the worker has mt mtntmuni 
safety and competency 'standards. 

As they provide rnore information In the marketplape and in school^ 
certificates have the potential to replace custom and prejudice in hiring; 
to replace subjective feelings wi th 'object tve 'measures of competence. 
As sucTti they can help wo|nen» blacks, and other minority groups to advance 
in the labor market., However* the tei^ts and standards developed must i 
not in their own fashion cceate-'a new bias in hiring^ toward those who 
do well on standardized tests* for exainple* but not on the Job. 
Views on the Effectiveness of Certification 

TWo studies by economists help to clarify both the potential role 
and the pratfalls of certificates In the labpr market; one, a model by 



Michael Spence of Job market signaling;^ |and^ two* a riodel by George 
Ackerlof of the effects of uncertainty on the quality of goods produced*^ 
Taken together^ they highlight the Importance of clear Information In the 
Job marketi the costs for the emnloyer If It Is not readily available^ 
^gjf;^!^ misallocatlon which can result from poor signaling^ and the groups^ 
particularly the disadvantaged, who suffer from It* 

Spence characterizes the hiring process' as Investment under uncertainty* 
Employers will use what)&ver signals or measures about the cornpetence of 
applicants they can find ai tow cost to reduce the uncertainty* In 
effect, they try to predict the performance bf applicants on the Job and 

■-i 

use characteristics such as sex, age^ previous work experience^ education 
and test results to estimate their productivity* These screens are 
based on both the prior experience of hiring and the subjective prejudice 
of the employer* They prox^fde a cheap way to sort through a pile ol: 
applications^ but they will hurt the Individuals who are qualified but 
fall to meet the en^loyer's criteria* Scree^Tkire ner^V probabilistic 
estimates of performance, and mistake' are made In both directions* 
^ Employees are hired whose subsequent work Is below expectations; conversely^ 
applicants are not hired whose performance would exceed the expectations 
based on blunt screening variables*^ 

Certificates can paly an Iniportan^ role In replacing the custom 
and prejudice detrimental to blacks^ womeiKaQi^he poor by objective 

fneasi^res of coirpetence* Those who can do better than the norm of previous 

*■ 

generations will have the opportunity to advance above It* 

However^ certificates themselves can be Itnpreclse and discriminatory 
as screens* If the certificate does not distinguish clearly the skills 
of the graduate and the nature and quality of the program^ then employers 
wIH group holders of certificates Into very broad categories. 
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All vocational students^ for exanple^ may bfe 1unv)ed together regardless of 

their level of skills or competence* The reason ls> as Spence points 

out> that it costs money for the employer to find out for hlm/hersetf 

about each and every applicant and each and every program* Those who are 

better than the cate^ry to which they are assigned are hurt by the 

btuntness of these assumptions* 

tn this regard^ George Ackerlof has described the costs entailed for 

youth coming from "^^hoots employers know to be In disadvantaged ntjtgHborhoods : 

***the unreltabMI ty of slum schools decreases the economic 
possibilities of their students* *** an ernployer may make a 
ratllDnal decision not to hire* any metd^ers of these groups Into 
responsible posi tions-^because It Is difficult to distinguish 
thoseywith good job qualifications from those with bad qualifications*^^ 

In his modelling of the effects of uncertainty Ackerlof further 
points out the reduction in incentives to excel for Individual students tn slum 
schools* If employers cannot distinguish the well-trained from the poorly- 
trained^ the competent from the incompetent graduates of a schooU they will 
offer the same wage to all* The better student has no Incentive to exceed 
this level of achievement^ and the poorer student has no Incentive even to 
achieve It* Over a period of time^ the quality of education of the 
entire student body falls and its reputation with It* Ackerlof has 
pointed out fo*' a variety of markets such as used cars^ credit^ or 
Insurance^ that uncertainty about quality creates the conditions for the 
"bad to drive out the good**' Ultimately^ there Is a tendency for a 
^'reduction In the average quality of goods and also in the size of the 
market*"? 

This tendency for uncertainty in a market to reduce quality is 
also at work among vocational schools and programs* If employers and students 
cannot easily discriminate among schoos^ tiien the incentive for providing 

^4 \ 
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htgh-quality training Is reduced. Converselyp fly*by-nlght operations 
can, and do, benefit from the general reputation of pVlvate schcK>ts 
and are abte to provide tow-quality training to tl>e unsuspecting 
student. Howc^ver, over a period of time, the confidence of the public 
In schools In general wanes as news Is spread of those who actively 
mif^lead potential 'enroUees. Ultimately, all schools can suffer 
from the reduction in quality and reputation which occurs. 

The uncertainty for ernptoyers stems from the large nqmbers of 
workers and schools in the iiarket and the IrVfrequency of contact 
with each other. Only In cases with wel ^developed links between ^a 
school and a small number of local employers is this uncertainty 
reduced over time by experience* There are several remedies in markets 
of this Sort: either chain stores, restaurants or schools which 
guarantc3 a standardized product across large numbers of suppliers; 
ox\ associations of suppliers td establish minimum standards. However, 
unless these standards are required by law, there are always firms- 
or schools which perceive n benefit from diversification and differen-^ ^ 
tiatlon from the norm. This might be in the form of increased specialization. 
Innovative programs or lowered quality. Once again, the lack of 
coordination In the vocational training system encourages healthy 
diversity, but the she^r number of programs makes It all but inipossible 
for employers to have anything but broad, sweeping generalizations 
about them. Ultimately, all suffer from the uncertainty created. 

■v. 

III* Postsecondary Vocational Certificotes 
and.Thetr Requirements ' 

Postsecondary vocational certificates Include the following 
major types; schodl diplomas or degrees, apprenticeship certificates. 



licenses^ voluntary certificates^ military certificates and the General 
Educational Developnient (G.E.D.) certificate. 

^ School Certificates 

School certificates are usually simply diplomas. They state that 
a student has successfully completed a program of formal study^ generally 
In an occupation as specialized as "transportation secretary.*' To achieve 
a certificate^ In most cases the student has taken a variety^of tests along 

the way. These are primarily written tests and often multiple choice. 

It 

Performance tests are comrrtDn only for the mechanical skills like typing or 
welding. 

The schools which grant these certificates are publicly or privately 
funded* The private schools can be nonprofit or for profit (proprietary). 
Thetr programs can range from a month to two years and cover fields from 
business to auto mechanics to medical records administration. There were 
over 6^300 such schools in I975 and well over 80 percent of them were prir 
7ate<, Table 1 shows the variety of public and private schools available* 

The contributions of proprietary school training was one of the first 
issues assigned for this study. Because of their training^ proprietary ( 
school certification processes**al though not the Paper certificate Itssftlf" 
^re distinctive. Proprietary programs pay closQ, attention to the Interests 
of ernployers and the needs of the students^ many of whom may have been the 
less successful students In prior academic settings* Most of the instruc* 
.tors come into teaching from the world of work. The instruction, particular* 
ly In the trade and technical schools. Is done In short Units with continuous 
feedback and evaluation. , The Instruction Is often done with more up*to*date 
t^equlpment than that which H used in public schools* The Instructors 
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Nc^collegfate Postsecondary Schools 
Offering Occupational -Programs 



Total Public Private 





1973 


. .1975 


. . 1S73 


1975 


.. 1973 


1975 


Total 




8»356 


893 


96^1 


7»953 


7.392 


Vocat tonal /technical 


M67 


M87 


579 


59^ 


• 588 


593 


Technical institute 


215' 


210 


52 


38 


163 


172 


Business/commercial 




1»U0 


1 


1 


l,2Jil 


M39 


Cos-metic/barber 


2,^105 


2^328 


h 


21 


■ 2,Wl 


2»307 


Flight 


1 ,m 


W309 


6 


ith 


li*77 


1,265 


Trade 


708 


723 


30 


30 


678 


693 


Home study 


130 


106 


1 


0 


129 


106 


Hosp i tal - 


1.2^17 


1.112 


170 


215/ 


1.077 


\ 897 


Other 


2ii9 


2^11 


50 


.21 I 


199 


220 



(Source; Departinent of Healthy Education^ and^lfare-*Natlonal Center 

for Education Statistics^ "Directory of Postsecondary Schools With Occupational 

Programs", 1973*197^ and 1975*1976.) 



are seen as responsible for the student's success* If a student dbes 
not make tt» It Is the teacher's fault* Hany prpprtetary schools also 
emphasize attendance^ dress^ and Interpersonal skills for the working 
environment* Poor attendance Is not tolerated and strict dismissal 
or class mdke*up pro^dures for poor attendance are common* Because of 
these features^ the graduate with proprietary school certification may 
weU have a greater degree of understanding of the work environment 
as they enter the job market tfnd more performance skill testing than 
the graduates of other programs* 

Apprenticeship Certificates 

Apprenticeship certificates are granted to those who have gone 
through training programs approved by the Bureau of At^prenticeshlp and 
Training (BAT) in the U*S* Department of Labor* There are over ^50 
apprenticeable occupations^ primarily In the skilled trades* Appren*. 
ticeship certificates are simply the formal statement, than an Individual 
has completed training In gn apprentjceable occupation. According to 
the Sureau^ apprenticeable occupations are learned through a structured 
supervised on^the^'job training program conducted by labor or Industry* 
They are "clearly identified and commonly recognized** throughout an 
industry* They Involve manual^ mechanical or technical skills which 
require at least 2^000 hours of work experience to learn* They also 
Include at least ]kk hours per year of related classroom instruction 
given \(i a local vocational school or convnunity college* 

in addition to the national recognition and on*th'^*jiDb training 
that meke apprenticeship programs distinctive^ they also have an interview 
process for ell applicants*' An applicant is interviewed by a group of 
four people about his educat1ot||p physical healthy interest in the Job^ and 
attitude towards >the woik* The^ responses In these areas are evaluated ^ 

" . ' ■ , . is 



and confined with an assessment of other personal traits to. give the 
applicant a score from t to tOO. This score will affect the Individuals 
chance to get Into his chosen program as soon as he would like* 

Licenses 

A license gives an Individual legal avfthorlty to practice an 
occupation* The authority Is usually granted by a state board and is 
required to perform ceftam tasks. For example^ any mechanic that 
performs FM-required inspections must be licensed by the FAA. 

Licensing usually requires experience or formal training* Written 
exaipinatlons are usually given* in a few cases^^for example^ plumbers 
and cosmetologists In soine states—performance tests are given* Minimum 

age requirements are common^ and statement attesting'to sound moral 

* 8 
charactermmay also be required* 

Licenses are required In all states for the foliowing occupations: 

barbers'^ cosmetologists^ embalmers^ dental hygienists, practical 

9 

ourses and_airplan^TOch^ Many more occupations are licensed In 

some states* There is a strong tendency for members of an occupation to 
band together as the occupation grows and request licensure from the 
state legislature*^'^ 

Voluntary Certificates 

Voluntary certification Is a nongovernmental recognition of 
competency In an occupation* It is not required for practice In the field 
t>ut it may be a means to Mgher salaries or promotions* The certificate 
is usually granted by a professional association such as the American 
Dentat Association or by an Independent agency such as the National 
Institute for Automotive Service Excellence^ whose sole purpose Is 
certification* . * * , ^ 

10 



As with' licensing^ cert{f1cat:on usually requires a certain period 
of experience or the coirpletlon of a formal course of training In the 
occupational specialty* Written examinations are given; It !s generally 
assumed that performance testing has been done through the training or 
work experience.^' ^ ^ 

Voluntary certification Is predominant In the allied health 
occupations. Some exairples are: 

Dental assistants * Certi fy.lng_Bo_ard of the American ttental 
Association; 

Emergency medical technicians - National Registry of Emergency 
Hedt cal TechnI cians; 

Medical technologists - American Hedlcal Tfechnologists or the Board 
of Registry of the American Society of Clinical Pathologists 
or the International Society of Clinical Laboratory 
Technologists ; and 

Kedlcal record technicians ^ American Medical Record Ai^.^oclatlon. 

In other fields* automobile and truck mechanics can be certified 
In several different specialties from front'end to brakes to dtesel 
renglries^,"^"FrrianHa^l~anaT^ "appfaTsers^hd"Tr^Ste1^a^ht's 
can also acquire voluntary certificates. 

Military Certificates 

Each of the Armed Services certifies servicemen In particular 
occupational conipetencles. In 1976^ )29»000 servicemen were trained In 
88 training centers and schools. The certifications awarded are knoi^rn as 
ml 1 Itary. occupational specialties (MOS) in the Arnry and Marine Corps^ 
ratings In the Navy and specialty codes In the Air Force. In the Army 
alone there are'over 350 MOSs^ with up to five skill levels designated 
for^^acMjOS. l^. , " 

Every enlisted man or vioman has an occupational designation. They 
a« the result of formal training and the tests can be performance or 
* ; 20 
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written tests. These certificates play an Important role In promotion 
and career <Jevelop:»nt* The certification Is Rationally the same 
within each Service but across Services the specialties may be named 
and develdped along slightly different lines* For example, jobs similar 
to civilian physical therapist work include physical therapy special tst» 
occupational therapy s):F^cialist and orthopedic specialist In the Army, 
hospital corpsman in the Navy, and physical therapist In the Air Force. 

General Educational Development Certificates 

The General Educational Development (GEO) certificate states that 
an individual has met basic education requirements at the secondary level. 
GED training and testing are for those without a hl^ sc^:>ol diploma, and 
the GEO certificate is often accepted as the equivalent to a diploma* 
Often GED training Is self-Instruction. Thus, the certificate shows 
that an individual has taken a test, but not necessarily that he has 
had formal training. 

_ GElL-testlng-i s^doQe-QO-fequWalent^Jtesis^ nationwide <^ -The 

is administered Jointly through' the GED Testing Service of the American 
Council of Education anrt state e^^^Jcatlon departments* While the tests 
are the same nationally, each state sets its own minimum standards for 
passage and sets its own policies In age requirements and eligibility 
for retestlng. 



IV. Evidence of the Role of Certification 
in Training Programs and the Lauor Market 



tn Its Ideal, form, a certificate can be an tmt^rtant signal to 
enplbyers^ students, schpols and consujneTS**a signal which facilitates^ 
hiring and promotion decisions, encourages Investments of youth in 
training, coordinates and controls performance of teachers and programs. 



21 



and guarantees an acceptable quality of goods and services* ^ Is there 
&ny evidence tha^ certificates and the certification process fulfill 



to be addressed: 

1) Does a certtficatet defined as/'a record of the competencies 
of an individual for employment" have an affect on hiring and 
promotion? If so* what kinds of information In a record appear 
to have^the most yalue as signals of , competence? Completion 

. of a. program? Test results? Or other information? 

2) Do certification processes raise quality and maintain stan- 
dards withrn schools and training programs? 

The Role of the Certification process In Schools and Tralnfng Programs 
Is there evidence that certification processes raise qualUy and 
inalntaln standards within schools and programs? There are s^everal ways 
in v/tilch thfs can wor|c: 

- - ^Tests and standards can motivate students* W^rk; 

- - -Student performance on tests can be used as c means of account- 

ability for teachers and programs; 

* - -The developmftnt of tests and standards can provide a forum as 
a means for admlnlstratorSf teacherSf researchers and employers 
to discuss and develop high-quality curricula* 

One test of the effectiveness of the certification process In rain- 
talning standards would be a compar'sion of the quality of several 
schools or programs and the extent to which they use tests and clear 
standards of performance for completion of a degree or program* Data, 
simply dp not exist to make this test* The performance of oraduates 
of several programs can be compared, but there are more factors than 
certification at^^work iQ^n .Institution which might explain any dif- 
ferences In graduates* 

Casual empiricism suggestSf however^ that ^these three certification 
mechanlsms-'student jnotlvatlont teacher and program accountabl Hty* and 



these Important functions? To answer this; there are two specific issues 




currtculum developnent^^can contribute to hTgh*qual!ty training* Inter- 



views and literature review t^veal that some program a<foitnlstrators 
*se1f*consctous1y do use certification In these ways and believe they 
make a difference* While there Is no evidence on how widespread these 



practices are^ comments of the administrators are nevertheless presented 
as examples of what can be atten^ted and^ hopefully^ adhteved* 

Motivation for Students 
Flrst^ It can be argued that difficult teits;wlth a critical Impact 

<>n entrance Into a profession are strong notlvators for learning* Law 

* * 

students and medical students study feverishly for several months to 
take their board exams; graduate students study for general exams* 
Whether or not studying for exams constitutes learning In the right 
sense ^as^ of' course^ been debated on many a campus* Nevertheless^ 
testing and grades remain a primary tnechantsm for motivating students 
and signaling to them what body of kna^ledae Is needed for professional 
or academic practice* * \ 

Proprietary school "representatives suggestj^TmrTarly^ that tests 
^d grades are ImfwMant tools for notlvatj^ vocational students* Many 
students are wary of te^s f rom Dr|pr'''1i^^ failures, but by developing 
short Instructional units and tests which start easy and become Increasingly 
difficult over time, schools can help students overc&me their fears and 
commit themselves to the program* A* Harvey Bel'ltsky In a 1963 study of 
proprietary schools suggests that the breakdown of a course Into short, 
sequential units (with graded. assignments tests) Is "perhaps the most 



distinctive method of Instruction foimd In private schools*** He cites 

as an example a mechanical drafting course with 3& units and a letter grade 

assigned for each* . 
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Belltsky points out the critical link found by psychologists beU^een 

success at learning and basic notlvatlon* He quotes Or* Oavid P* Ausubel 

frequently the best way of mottvatlng an unmotivated pupil ts to 
t'^nore his motivational stdte for the time bp^ng and concentrate 
* on teaching him as effectively as possible* Huch to his surprt&e 
and to his teacher'r^ he will learn despite his lack of motivation; 
and from the satisfaction of learning he will charactertsticaMy 
ctewlop the motivation to learn more* 

Paradoxical ly* therefore* we may discover that the most effective 
.method of developing Intrinsic motivation, to learn Is to focus 
on the cognitive rather than on the Tnotlvational aspects of 
learning^ and to rely on the motlvatign that Is ^^vetoped retro* 
actively from successful. educational achleveifent*^^ 

^- 

Belltsky cites other Incentives for students to study In proprietary 
schools which are related to the value of the certificate In the labor 
fiiarket* When 128 schools were asked about factors used to maintain 
student interest^ they ctted the following^ In rank order: visits by 
employers or their representati ves> breakdown of courses into small 
achtevementcuni ts^ vocational^ counsel 1 ing^ and ylsits to plants or 
offices* As Ackerlof's model has suggested^ the clarity of the signal 
tQ the employer and the promise of a future Job Is an Incentive for 
achteventent' within the program* 

Karen Lane> Education Director of the Hedix School In Baltimore, 

^ ♦ - 

described for this study , one of the rea^ns why students like their 

pass-fdfl competency te^^fi^ usually performance-based: 

Host students rave about the competency assessments because they 
jt are ^ated against an objective standard* They are not up against 
the rest of the class or a subjective Instructor* 

Only A students don't like t!ie tests^ because *'the^^re not distinguished 
from the rest." 

Tests and skill records are proving to be Increasingly useful as 

a signal to students of what they should be learning In other areas 

V 
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of education and tralritng* George Ziener of the National Institute on 

Drug Abuse states that In the credenti a1 tng of drug abuse workers tn 

Pennsylvania^ *'The tnformatton on rask analysts goes to the Indh'tdual 

to show him/her what skills must be documented fn the fle1dj< Clay 

Brlttatn» tn the Uo5* Army describes the Soldters Hanuai for Skill 

Qualifying Tests (SQT's): 

The Soldier's Manual Is the Individuals quidebook for MDS training* 
The manual lists the critical tasks at each skill level of an HOS» 
and for each task describes the requisite perfoniianca*^*and sped* 
fles the acceptable standards of performance* ***(lt} must 'be' In 
the. hands of the soldiers at least six months prior to skill 
qualification tbsting»t**(and} delimits the domain covered by the SQT* 

Later» students get a nore specific notice^ whose purpose Is **to exploit 

> 

the power of £ test to motivate and direct the learning efforts of tho5e 
to be' tested;*' 

Finally,^, forty states have now passed some kind of legislation to ^ 
develop minimal conipetency testing In public schools* While data Is not 
yet available on the results of all these effort^. In Florida, Turlington 
found that such state standardized tests 1^ grades 3» 5» 8 and 11 have 
led to ''dramatic tncrea5^95 In performance" and '*grc^tfing jtudent Interest 
tn school*** ■ Black Students lo the lUh grade, for example, showed a 

A7% Iirprovement In math scores from the first year of the program to the 
second^ and a 15% Improveoent In communications scores* Over $0% of 

* those who failed th^ first year passed when retested* Turllngtc.i claims 
these Improvements are due to the state conipensatory education program^ 

Increased dtlJfgence of students, more emphasis on academics, and Irrproved 

^ 15 ^ 

atmosphere In scho£>l* . ^ ^ 
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AccountabHtty 



Casual emptrtclsm also suggests that tes't scor::i-'and grades are 
used as tools of accountabtllty for teachers and schools, tf students 
^ one*professor*s graduate statistics course cannot pass^ the department's 
jgenerat examtnatlon^ the faculty -takes note* Either' t^e course Is revtse.d 
or the faculty ranter replaced or both. SlmMarlyJ scores of students 
on ^p'fltude and achievement tests are used as measures of quattty of the 
school aU the way from first-grade to graduate school. Refults are 
now pMbllshed fireqiientty» for example,- cn the achievement levels of 

students relative to national nprms. 

J" ■ 

Fbr a long, period proprietary schools have used test results of 

students to evaluate teachers. As Belitsky noted In his study In I969: 

. ..most prWate schools consider a ilzabte number of student 
failurps In one instructor's course, or, In several of h[s courses . " 
over time} an Indication of the .Instructor's failure/ 

The schools a'4 cbnvtnced that creditable teaching performances - 
can^^^nsured by making teaching capability the main criterion 
'for reward and advancement; and Instructors are not usually given . 
tenure. 

Such practices were derated in Int&cVlews for this s:tu^ Karen 



Lane of Medtx states, "If fourteen, out 



of s] 



xteen students do the task 



wrong, the Instructor has a problen/* and Is held accodnt^ble to solvje U. 

^ * ■ 

Helen Donger of the N.Y. Ini;tltute of Dietetics says: 

If In a class » three out of twenty students fait, the prbSlem 
is the jitudents. If ten 'Out of twenty ^all, that's a signal that 
thej^ts something missing between the student and teacher, that 
thfty have lost a, common understanding of the objectives of the 
Instruction. . 

Brittain of the U.S. Anny describes their ^se of perfq^mance on SQT's 
for program accountabHtty: \ ^ ^ 
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the goal Is to Identify ^performianf^e deflcl&^ncles' ami to^focus^ 
and direct training efTo/ts whet'e they are most rmeded/ In terms W 
' of such objectives^ StTT failure rates^ at least fp'r a tlm&^mayr. . 
one of the more sfgnlflcant barometer^gf ouf «iic{:e5s« 



Educational researchers such as Gltck» Henning and Johnson believe 

that the new move to conipetency*based education (CBE) of students tn 

pubffTscfiools will create an^»'accountabn I ty forum*"^^ While It Js 

too soon for conclusive evidence^ Castelte Gentry claims CBE will ''render 

our murky Instructional processes visible*' and teachers will be held' 

18 

\ accountable for sfOdent performance. H.S^^cAshran speculates on the 
X \otentla'f uses of CSE: avoidance of course co^^t duplication, individual- 
ization of Instructton» consistency within courses^ T^^oVed evaluation 
^ systems, and refinement of state accreditation.^^ 



Curriculum Destan \ 



Finally, the development lof tests and cert I fl cat twi standards does 

appear to begone ioeans for discussing the needs .of the job or profession 

^nd, Indireqtly, for designing thfe curriculum* In reviewing the CBE 

movement, Airaslan, Hadaus'^and PeduUa write; 

^ ^ / ^ 

- ' It Is trnposslble to cpnfrorrtthe spectre of minimal competency 
testing without addressing suchxouestlons as what schools should 
teach» what schools can teach» t^t are reasonable public expecta* 
tlons for the educational svstem» Its teachers^ and/Hs pupils^ 
and what ts a complete puplt. 

Potentially 1 1^ can pcovl de the Impetus to reexamine our educational 
^ystem^and oOf expectations for It.^O 



In the military^ courses designed by ^-'^eclal I^ts are titso increasingly 

** 

based on task analysis and performance. Says Brittain of the Army: 

SQT*s are the levers for Influencing Individual training. ...tasks 
(In the SQT's) are selected In terms of the extent to which they 
neetf to be made the focus of training efforts. 

Researchers of military training report that designing courses, arcund 

21 

performance has reduced training time from 25% to 30%. 
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The Value of Certificates tn'the Ubor Market ^ 

toes • cerflficatfe of vocational training serve as a stqijal of 
job competence in the labor market? Do eirptoyers use the information in 
this **record of competence" to hire and place'mrkers in jobs where 
their training matches th^ requirements of the work? What types of 
information are employers responsive to**specia1i2ed. skills, TOmpletion 
of a program^ grades, the Institution attended? How much value to which 
groups does a certificate have? 

If the certificate were an tinportant screen used by employers In 
hiring ahd promotion^ one^^wouid expect to find a significant relationship 
between the type and amount of training taken^ the performance level of; 
the student, information about the program In the certificate, and 
the skills involved in the Job attained by thewrker* This relationship 
Is hard to test with avatlatTfe studies* Large survey samples of graduates 
of r)ost?econdary progij^ams have minimal detaM on the specific nature 
of trainjng_recei ved^-the certi fjcation or standard*setting process and 
^he Job taken; on the other hand, more detailed studies of schools and 
local labor markets may not be generalizable* Further, the ccnventional 
tbst v\ the role of a certificate Is an Increase lit earnings following 
training, but there are many non*monetary compensations and Institutional 
factors which make It hard to find the link between level of skills and 
success In the labor-market* Nevertheless, the conventional test is 
the primary test of the effectiveness of vocational training In the studies 
cited betow* 

In general, participation In postsecondary vocs^ttonal training does 
appear to function as a signal of competence to employers; probably both 
a signal of motivation and of exposure to at least some training* Recent 



reviews by Grasso and Shea and by Ddnrra^1szev;skl of studies of vocattonal 
graduates conclude that wRile enrollment In hfgh school vocational programs 
does not bring long*tenn Income benefits, enrollment In postsecondary 
programs does» In particular for blacks and women. Graduates of training 
programs also believe that training ts valuable in the labor market. In \ 
ihe NLS Surveys of 1972 high school graduates only 7M% of those who had 
had formal postsecondary training said that they could have gotten their 
present job without tt.^^ 

In certain Instances^ the^certiftcate Is a very precise signal In 
the labor market. In these cases» the certificate serves as a critical 
screening device for the employer and the skills learned have a direct 
application to the Job taken by the individual upon completion of a 
program. Examples of such tight linkages are cited In the literature 

* 4 

f 

and debate over the viability of public school vocational training. In 

a recent Washington Post article discussing the currently poor reputa-. 

tion of vocational education^ William Raspberry quotes from a letter 

Sent to htm by a Minnesota educator: 

...38«6 percent 6f last year*s graduates of St« Paul Technical 
Vocational Institute are working In their vocational majors or 
closely related fields. For technical graduates^ the figure was^^ 
39.1 percent^ with an average starting pay of $866.52 per month. ^ 

c 

Such Instances are usually characteriz?.d by one or more of the 
following factors: 1) a highly visible school with an outstanding reputation 
(often a^chaln school such as Katie GIbbs Secretarial School); 2} direct 
and frequent communication between a school and one or several local 
en?>loyers; or 3) strong demand In the labor market for specific skills^ 
and the unwillingness^ because of high turnover rates» of the employe;^ 
to provide his own training. 
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Harvey Bfilltsky cites several exairples of close ^^Inks between 

ptpprietary schools and eirployers: 

...acute shortages ^of truck drivers lirpelled truck owners to 
visit a school and 'give all sorts of suggestions.* ...the 
PrestdentN>f Mldwa^echnlcal Institute of Chicago testified that 
a boat manufactuTer had asked hltn to set up a course tn the 
repair of frtergtass hx>BtsM 

As Jn Acfcerlof*^ desjcrtptlon cited earlier^ one way for schools and 

employers to'cooperateN^ Increasing the value of the certificate as 

a screening device Is to establish a specialised program which meets 

the needs of a segment of local eirployers. Over time trust Is built 

In the graduates and ultimately In the j:ertl ficate. Helen Oonager of 

the N.Y. Institute of Dletettcs^ for example^ describes her close contacts 

with employers as follows: '*The program is known %*en enough that 

employers call and trust my Judgment to send them good people." 

Certain types of occupations and firms also depend heavily on formal 

training programs to prepare workers for Jobs. For these jobs^ such 

as chef^ electrician, computer programmer, or draftsman, the worker's 

attachment is to the craft, but not to any specific employer. Therefore, 

firms are unlikely to Invest tn any training of their own and select the 

applicants wh6 have demonstrable skills In spectalited areas. Union 

* apprenticeships and Jobs, which tn- 1965 constituted 9.^** of all Jobs,25 

are a prime example of this pattern of fonnal training and hiring. Small 

frms. In general, are also less likely to do formal training than large 

firms, perhaps because of limited resources and higher turnover of employees. 

These examples, however, do not appear to characterize the role of 

vocational certificates across the wider labor market. Studies which 

examine the experiences of national samples of youth and adults or which 
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look at more than one or a few schools^ find that the certificate 
furftqttcns only as d weak and diffuse signal of Job preparation* Some 
training at the postsecondary level helps students find hlgh^paylng 
skilled Jobs* But fine distinctions of type and quality of training do 
not appear to count for much In a wide spectrum of fields and labor 
markets* 

Empirical evidence suggests^ for example* that distinctions such 
as completion vs* non-completion of. a program* length and difficulty of 
program* or institution attended are not related to placement of viorkers* 
In a study of the Fames data on young men* Olsen found the following 
two results: 

1) For otherwise stmt lar young men^ those wfth less than three 
(full-time) months of private vocational schooling earn higher 
wage rates than those with none of this schooling* but the longer 
students attended the schools the smaller is the wdge premium 
(In fact* persons wfth more than about one full-time year of 
vocational schooling actually earn less than otherwise similar 
Individuals with no vocational schooling)* and 

2) Except for inner^clty youths (for whom dropping out has serious 
consequences) y wage rates of persons who attended vocational 
schools for a given amount of time are essentially the same* 
whether they stopped going because their program ended or whether 
they dropped out*^^ 

If completing a progr^ Is considered equivalent to receiving a school 

certificate* this study Implies that completion Itself (not training 

Itself) Is very Important for inner city youth and of little consequence 

to others* It may be that employers pay particular attention to corrr 

pletion^as a signal of motivation among a group that they believe has 

particularly serious attltudtnal and motivational problems* (Figure l) 

* Another recent study of graduates an(l drop*outs from publlc.post- 

secondary vocational, programs found no addition to earnings from completing 
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Figure 1 



Estimated Proportional Effects of FulI*Tiitie 
Equivalent Vocational School Training 



Proportional 
^effect on 
post-training 
wage i^tes 



Inner-city completers 




Length of train! ng 

(in fult*tiitie equivalent years) 



Inner*'Clty dropouts 



Source; Olson^ Lai^rence S», *'An Eiiipirical Study of Decisions Involving 
Vocational School Training/* Study done for U^Si. Oepartitient 
of Healthy Education and Welfare* Office of Education Bureau 
of Occupational and Adult Education* 



a program* Weltfprd Wilms found that drop*outs f roirv-^programs v*ere nore 

likely to be from disadvantaged backgrounds^ but ulttinately earned no 

less than those students of the same class and background vi^o went on 

to graduate from the program. 

Finally^ In the late sixties and early seventies^ a nuftJber of . 

studies were done on the labor market experiences of graduates from 

different types of programs* Three studies stand out: the Allen and 

Gutteridge study of business school graduates In upstate New York from 

1962. to 1971; the Wolman study of public and proprietary graduates from 

four major cities (l972); and the Wilms stMdy of 2»270 public and 

27 

proprietary graduates (197^1)* All three found that within a given 
occupational area there are no consistent differences In labor market 
successes between ptibllc and proprietary schools* 

The Wilms study Is the only one which carefully controlled for 
the background characteristics of the students* Even with these care** 
ful controls the overall results were not much different* The study does 
suggest that proprietary schools have somewhat better placement records^ 
particularly In the higher-paying, higher-status technical occupation?* 
But better placement records do not necessarily mean higher earnings* 
Overall » the prograns have much the same economic value for the Individual* 
In a recent survey of employers done for a study on external degree 
candidates Sosdian and Sharp also found, that "employers—although favor- 
ably dfsposed towards education In general "as a group are not overly 
concerned with Institutional reputation*'^^ 




WhY Vocattonat Certificates Are rtot Hare Valuable 

There are a nunJjer of reasons why vocational certificates as they 
are now designed and used do not carry riore wight In the tabor market. 
Som of these have to do with the current state of the tabor market and 
the way targe employers hire; other with the decentralized nature of 
the training system and the methods used to certify Individuals. 

Skill Mismatches 

Firsts much of the potential value of the certificate to the enploye 
and student Is lost when the skills of graduates do not match the require 
ments of available Jobs* As they enter college or training students 
perceive both high pay and openings tn various fields but> without any 
means to coordinate decisions^ too many invest tn specialized education 
to be accomodated. Employers do-not adapt their technology and hiring 
practices quickly enough to absorb the resulting excesses. Specific 
occupational fields^ like agricultural labor markets^ experience cycles 
of surplus and glut» as students under- and over^shoot actual demand 
In what has been called a cobweb pattern. Richard Freeman has Identi-* 
fied such cycles In the markets for lawyers^ engineers^ and other 
technlca11y*tra{ned workers* * E^tperlences of vocational graduates 
have also been shown to depend on the state of thetr specialized labor 
market at the point of graduation. In part because of such cycles^ It ' 
appears that those students who are willing to switch out of their field 
of trairving actually earn more than those who stay. 

Freeman and others have atso documented a general decline In the 
vatue of the college degree which followed large*sca1e Increases In 
enrollments In the t960's. The rate of return to a B.A* fett from \2% 
to B% between 1968 and 1973. These Increase^, tn college enrollments 
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have had Important ramffi cat tons for the vocational student* as well* 

As the supply of co11e9e*;educated manpcv^r Increased beyond the capacity 

of the labor market to absorb them* employers began to upgrade their, 

educational requirements for jobs which do not appear to require them* 

Margaret Gordon has estimated that fully kdX of the Increase In env)1oy* 

ment of college graduates between 1959 ^nd 1971 was due to such Increasing 
■ ' 31 

credential Ism* Studies by Ivar Berg and James O'Toole In the early 
1970's confirm that In these jobs Increased education does not result 
In greater productivity* 

*■ 

Christopher Jencks has* also been greatly concerned about the rote 

of credentialing in society* " In his studies of the economic value of 

college education^ he found that the first and last year bring substan* 

tially higher Increments to earnings and occupational status than 

either the second or the third* Differences In ability or achievement 

of those who finish vs* those who do not cannot explain this finding. - 

Jencks offers two expjanatlons: either employers view completion of 

a program as a reliable Indicator of motivation and perseverance and 

these qL^lIties matter on the job; or^ the degree Is singly being used 

for convenient* but unsubstantiated* rationing of the good jobs In the 
33 

econont/* 

Jencks fears that use of completion of formal schooling as a screen 
on the part of en^loyers discriminates unnecessarily against Individuals 
and groups In society who can do well on the job* but not In school* - 
Traditions In hiring which favor the literate* verbal* and Wftll*educatcd 
perpetuate a system of tracking and Imer achievement among blacks and 
blue*collar and working-class groups. Their low Income limits educational 
opportunity for their chl Idren; thel r cultur* underestimates their potential, 
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Hn-tM-end,- whUe.,youtK^i!dght_be_ajye^^ effectively on the job, 

they fire excluded by their lack of academic credentials. 

Vocational students. In particular, are adversely affected by such 
patterns of hiring* To the extent that enf>1oyers use the college 
credential as a cheap and easy screen, workers who have learned the 
necessary skills In a vocational program, but have no college degree, 
will be excluded from Jobs they are qualified for* Such exclusion 
will be exacerbated tf the vocational certificates whtch they hold 
do not clearly specify the motivational attitudes and basic skills 
which efnployers seem to care about, as evidenced tn Jencks' study* 

Well ford Wilms' study of vocational graduates in four cities in 
15>73 demonstrates empirically how this general phenomenon of over- 
education of Americans affects skilled workers* He found that only 20$ 
6f graduates of hfgh**sklll programs took Jobs commensurate with their' 
training, compared to 80% of graduates of low-skill programs* fbst 
graduates chose to stay tn their field of training but lowered their 
expectations and accepted lower-paid Jobs* Wilms provides the following . 
two examples among many: only twenty-four percent of computer programming 
graduates found Jobs as programmers or data-*processIng specialists, 
fifty-seven percent took clerical Jobs such as keypunch-operator or 
clerk-typist, and nineteen percent tooH totally unrelated, low-status 
Jobs* Even as long as three years out of school, the graduates who took 
lower-level but related Jobs had not been promoted Into the Jobs for which 
they were trained* Conversely, eighty percent of those who studied \^o 
become secretaries, got those Jobs* 

There are undbubtedty several factors at work here* Evidence show!4 
that college graduates are taking the Jobs ahead of vocatlcnal graduates 
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and this may Indicate over*credentlalIng* However^ cnployers may also I 

be dissatisfied with the training In vocational schools* For exanple^ 

tn the Boston area^ one of the four labor markets studied by Vilms^ 

new hires in conputer progranmlng were aTnost exclusively from universities 

and colleges or from internal training pTX>grams In 1978* In Interviews 

with twenty^one enployers^ Mazzeo^ Sum and 5awhney found that graduates 

from vocational In^f^utions were not currently meeting their hiring 
35 

requirements*^^ One of those Interviewed stated that hiring from this 
source had fallen off in the previous 3 to 5 years^ because ^'gradually 
the caliber of these graduates began to deteriorate until they had no 
advantage over persons hired from within the firm*" 
- - Hiring J.ractices of Lar^e Firms 

A second reason why a certificate may not serve as a strong signal 
In the labor market is that many large enployers hire workers primarily 
at entry-level positions of low sicilU^ Skilled Jobs are filled from 
Internal promotion and on-the*Job training^ not from external sources 
of certified graduates* In effect^ enployers put new employees on a 
trial period of employment^ gatn relevant and detailed Information 
on their capabilities and promote only-those with the appropriate attitudes 
and potential for skill development* Training in the necessary skills 
ts then provided directly by the employer* 

In these cases^ employers are not looking for specific skills^ 
but rather for the potential employabillty of the individual*' In this 
regard^ they are Interested In generic sktUs of reading and writing^ 
positive attitudes toward work and interpersonal skills* While a vocational 
certificate may be a signal of these factors^ the precise field and length 
of training may not be Important* Othe*' screens of reconinendatlons or 
entrance exams^ or customary favoritism to men and whites may. also be tn use* 



-52* i 

Ooertnger and Plore have^characterlzed these patterns of entry- 
^ level htrtng «nd promotion from within as Internal labor markets* tn 
their study^ Internal Labor Markets and Manpower AnalysiS j they provide 
a^ estimate by Orme W, f'helps that In 1965 about Sk% of workers were In 
firms with varying degrees of openness to hiring from the outside at 

4 

high-sklll levels* ^In stee) mttts^ petroteuin refineries^ paper mills 

and other prDcess Industries^ Doerlnger and Piore found tines of pro^ 

-.gresslon-^from entry*level, low-skllt Jobs to htgh-sklll Jobs to b^e almost 

cotnpletely closed to outside applicants* Recent work by Paul Osterman 

suggests that exclusion from these entry*level Jobs Is a critical factor 

37 ■ 

In high youth uneniployment* 

The Non^ResponsIveness of Training Programs to Emt Toyers^ Basic Needs 
In retfent years^ widespread cllssattsfactlon with young workers. 
Including vocational graduates has surfaced* Eniployers are not finding 
the coiT^etencies and traits tn youth that they believe to be lo^ortant 
on the job and they see the school and training system as a primary cul- 
prit* Pannell has sonmarUed the findings from employer surveys over , 

the last ten to fifteen years* Their crItT<;ues Include: 

« 

***the schools tea^ obsolete skills^ vocational courses do not 
teach what they claim to teach; training Is too specific* anxJ pro* 
duces «rorkers who 'are unable to Vjust to technological change; 
basic English and mathematical skills are beings neglected by ItKe^ 
schools; and graduates often have bad work habits dnd attitudts*^ 

Within thf4«mst» Increasingly loud complaints from employers concern the 

lack of j^astc skills and poor attitudes toward work* If schools do not 

deal with such Issues^ then the certiflc^ate is not a meaningful signal 

of eligibility for the Job* 

Basic Skills^ In a 1977 Conference Board study of firms with over 

500 enp1ayees» Lusterman found at^ least half of,.the sample fault schools 
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at all leveli for poor preparation tn reading, coinmuni cation andwrHtng; 

If any generalization can be fnade» it is that^ at all. levels of 
schooling, too many ettiployees lack the language capabilities that 
* executives think they should have* Entry level blue*collar workers 
may be fimctionally Illiterate; clerical workers may spell or 
punctuate poorly, speaker write ung];a[TVTtatically; supervisors^ 
managers, scientists and other professionals may be unable to 
organize and present Ideas %^11» orally or in writlnfD^d 

Reading and writing, as well as arithmetic skills, are in£»ortant to 
employ;ers because they appear to be essential to performance on a wide 
range of Jobs* Educational researcher Arthur Smith characterized such 
ski 1)5 as "generic,** the 'Ibehavlors which are fundamental to the perfor- 
mance of many tasks and sub-tasks carried out ^n a wide range of occupa* 
tlons/' Such generic skills can include multiplying whole nurtisers, 
givintj discipline, diagnosing work problems, and hand/eye ccordinattcn. 
Without these basic skilts^ enployers have found It difficult to train 
workers for specialized jobs* Dean Klmmerly^ Vice President^ Department 
of Human Resources^ Hichael Reese Hedlcal Center, reports that the Center 
ha^ been forced to initiate special remedial training, **because 10% to 20% 
of employees are functionally Illiterate and cannot respond to existing 
in-'house training*" 

Employers are particularly concerned about the **trainabnity** of 
workers In those sectors of the econoniy with ever-changing skill needs 
and technology* Lee Covert of tBH explains that employees are contlnuousi 
being retrained over their tenure of twenty to thirty years with the firm* 
R>r careers such as these* ert^loyers need to find workers who can respond 
easily to change* Generic skills are an Tmportant part of such adapta- 
bility* Lostemian quotes an officer of a large manufacturing^ firm: 

It's Impossible to know what our manpower needs wIU be In five 
or^ten years* and therefore the basic need Is' for flexible people 
who have been trained In reading* writing,* basic computational 
skills* and thinking* We can ,teadi them the rest*^l 

iS9 
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Hottvatton and Good Work H&bUs; Does the ettiployee shov^ up on time? 
he or $he a cooperative worker? Does he dress ah^roprtately? Does 
she $ee a job through to its cottipletton? fhese are som of the elements 
of iTOtlvation and good vfork habits wht^^ are mentioned by ejnptoyers ] 
and fronltored by scrtoots who clattn to be« attuned to ettip1oyer*s desires* 
In a recent study of how 23 eniployers In New Hattipshire evaluate their 
en]p1oyees» for exan^Ie^ the conclusion was that throughout school^ student 
needed better training In wo/k habits^ attitudes tovfards work and Inter* 



personal relations* 

These attitudes and habits are sorctlmes mentioned as a new area of 



concern^ perh^'^Sy as some believe^ because motivation In general Is deterl 

orating In the workplace* In a Business Roundtable Conference tn November 

1978, Thomas A* Murphy / Chal rman of the Board of General Motors stated 

his* continuing concern: ^ ' 

***rare1y Is a young General Hotorjs employee fired because he or 

she can't handle a job***The vast majority of failures In holding 

Jobs are due to bad personal habits, not the demand^ of the Job 
asslgnment*^^ 

Lewis Pay, Chairman, of Bethelehem Steel Corporation agreed that many youth 
are not ^'rccrul table" because of bad personal habits and attitudes* Such 
factors are particularly Important In the steel Industry because of the 
Importance of safety precautions and practices on the job*' 
Quantity and Confusion of Certificates 

Th^ nuirfcer-of different certlftcates in vocational training U over- 
whelming for prospective students and employers alike: each of the 8,00f' 
to 9,000 vocational schools has several diffejjent programs with diplomas 
or certificates awprdell; In the U*S* Army ther^ are over 350 military 
occupational specialties (NOS); within the huatth field, there are 717 
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Job categories^ many of them with their own certification tests; each 

'State has Its own licensing examlnatton In a wide variety of occupational 

fields} tticre are* o^fer ^50 apprentlceable occupations through the ^ 

DepartTOnt of Labor. Until recently^ there has been mlnimaV coordination 

avnong these schools^ programs or licenslos boards to establish comnbn 

standards or tests. Indeed* one of the supposed strengths iii the system 

has been the flexibility for schools to^Jevetop their own particular 

versions and orientation of training. 

The diversity and decentralization In the system creates problems^ ^ 

' howver for the schools and the recipients of certl Ctcates : 

"the uncertainty surrounding the standards behind certificates 
reduces their value and 

4 

"th^;;jiverslty of cert?ftc5tes limits nobility of the individual 
out o1^ the local area where' a certificate 'may be known or between 
statesNrtti^ different 1 1 censi ng exams. 

Ideally* employers would have precise Information on the skills of 

the applicant^ through standardized tests* for exarapte. Absent explicit 

measures ^for the indlyt^uaU the employer may rely on h{>s/her impresslbn 

of the school or program attended and a grade transcript* If^any* from the - 
^— — ^ ^ 

school. In effect*^ the employer treats the school as an Intervening 

screen; if the student had the perseverance and the ability to get through 

c 

a known program^ the employer can assiime at least a minimum of skill competence 

Most employers* particularly small flrms^ however, do not '^ave enough 

experience with graduates of any one school to develop a stropg and 

reliable Impression of 1 ts progrwns^ or graduates. It appears^ rather^ 

that very general Impressions are formed about the quality ^of broad classes 
■ * 

of sphoots; ^^pollegesTf proprietary Vocational schools; app/enticeshlps* 
the 'fri Ittary and CETA. But the uncertainty created by the wide dWersity 



of progran^^ leads to a general discounting on the part of employers^ 

renoves Incentives for programs to provide high quality training^ and 

encourages a decline tn quality withtn the system as a whole* 

Even If a school is vr^tWknown In a local area» ! ts reputation wtl I 

generally not be widespread across the country* As a result^ the mobUIty 

of graduates will be somewhat limited* In licensing as well: 

. Regional or^state control usually results in non^'unlform standards^ 

which require the practitioners to undergo reexamination or to 

otherwise qualify for, reciprocity before they can move their practice 

across a regional or state boundary**'* 

The Directory of Selected LIcensable Occupations Includes' about 800 pages 

of fine print on the requirements for licenses In different sjtates and 

represents a valiant effort to^sunvnarize the diverse requirements of occu* 

pational licensing* KoweVer» much of the Information may be out o^ date 

and new information 1^ not quic^cly attainable by the individual* This ■ 

adds a search cost to the expense^ of getting relicensed and a deterrent 

to mobility across state lines* 

Imprecise and Biased Tests and Certfsficates 

Host certificates fall *n several way? to signal appropriate infor* 

mation to the employer: 

"they focus on specialized skills^ when employers are Increasingly 
concerned about baste sktlls and ^,ork habits; 

"they indicate the student has met a minimum standard* but do 
not differentiate among average and superior students on level 
of training; 

"they are based on tests which bear minimal relationship to per- 
formance on the job* 

. The majority of certificates in the market focus on the specialized 

skill competence of the graduate* A soldier* for example^ may be certified 

'* * 

as a Hllltary Occupational Specialty Code IZCt* a bridge specialist^ but 
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It Is difficult for a r>on*m1 1 1 tary employer to determine vfhat enslneerlng^ 
mathematical or diagnostic skills thft sotdier has or whether he Is a good 
worker* tn some occupations such as counsel! fng and sa1es» inten>ersdna1 
skills are critical but not easMy nteasured. Host certificates do not 
document these less quantifiable competences and employers must guess 
whether they hays been acquired In the training or experience that are 
behind^ the certtftati^V 

These perceptions are readily apparent to proprietary school counsel! 
and administrators* Helen Donager of the New York Institute of Dietetics 
reports that colleges ask for transcripts of their graduates; etnployers 
ask Instead about the student's 1) performance^ 2) punctuality and atten- 
dance» and 3) ^illty to^et along with others. William Fennelly^ the 
President of ITT Tech in Massachusetts^ states similarly that when employe 
call about students^ tt Is primarily to request;:^n attendance record and 
report on conduct. 

Surprisingly'^ certificates have not been adapted to such concerns. 
Hary Tenopyr» Manager of £mploynient Research and Systems for American 
Telephone and Telegraphy claims that "the education system Is letting us 
down*' and explains that AT&T Is responding by developing a new set of 
entrance examinations to test the basic skills of job applicants. One 
mining company is developing its tests to identify basic skills* 

Host certificates show an enployer that an individual has vtet a 
certain minimum standard* For example^ it may Indicate an average score 
of ^ove 70 in ten classes^ but if the student »s excellent in problem 
diagnosis and very poor In arithmetic* thet i/I 1 not be shown. It may 
show that the student^ can type 60 words a min ta, but the typist who can 
do better than that is not distinguished becei se the certiricate does not 
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document a range of .scores* Some schools have merit certificates to 
distinguish performance! but In most cases a certificate shows only that 
a person passed a minimum threshold* 

Finally^ tests of competency are usually part of any certification 
process^ but they may be Invalid Indicators of job performance. , Tests 
are usually written and measure what tho student knows about a task or 
how well he/she analyzes a problem In cognitive mher than practical 
terms* In a 1976 review of testing and occupational certification^ Hecht 
found that little effort was being put into the design of tests for job 
performance; 

Few studies are directed at the predictive validity (of tests) 
or the performance which can be expected on the job. Hany seem 
content to relate exams to academic measures based on curriculum 
content and training which have no proven relationship with the 
tasks to be performed. Host exams are put Into use before validity 
studies are started or with none in mind until problems Identify 
themselves* ^5 

Employer screening tests have also tended to be based on cognitive abilities^ 
rather than hands-on perforntance. 

The inequities of such certificates have been suggested earlier. 
Employers may use the certificate because It bears some relationship to 
Job performance. But there will be^ on the one hand^ appltcsnts who are 
hired who do well on written tests^ but not on the job; on the other hand> 
applicants will be excluded who are competent to perform on the job^ 
but not on written tests. The fact that this bias has cut across racial 
and Sexual lines has created pressure for more relevant tests. Tunkel 
and Klein^ for ex^ple^ found In a study of vocational education Instruct 
tors^ that blacks do equally well as whites In performance tests but 
consistently worse on written tests In the ^am^ area. Tests to measure 
verbal and math abilities have also been found* to be unrelated to job 
performance of the hardcore unemployed, '^^ 
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Shitnberg has documented other failings in the use of tests for 
certification* The tests may be based on inadequate assessments of how 
deep the knowledge should be for a given job. They tnay Include questions 
that are not relevant to contemporary practice. They may fiave anfclguous . 
multiple choice questions and ambiguous standards for scoring. The questions 
tnay not discriminate well among different levels of knowledge. All of 
these factors reduce the pr^edictlve validity of the certificate for the 
employer and Introduce inequities Into the hiring process between those 
who pass and those who f^il unnecessarily. 

V. Reform Efforts: Whither Certification and Competency Testing? ^ 

Given the problems with existing certificates and tests» it is not 
surprising that efforts are beinq made throughout the vocational education 
and training system to imprave. External pressures from employers^ 
mi nori ty^ groups and government^ arid internal pressures to make certiflca-^ 
tion a meaningful process have !ed tc the foltor/ing: increased attention 
to haste skills and Work attitudes in training; standardization of certi* 
ficates; research on the predictive validity of certification Instruments; 
and the development of new tests and of new toots to document skills. 

Basic Skills and Work Attitudes in Training 

In, conversations with employers for this study» three qualities 
needed In new hires were discussed; basic skills^ good work b*"Mts and 
specialized skill* As Lee Covert of I6H said^ *Vhat we really want is 
the best qualified applicant for any position.*' *'(^ual I f i^^d'* in his view 
Includes specialized skill training. The payoff Is obvious**as long as 
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the e.^loyee does not demand a salary so i^^9^ that tt exceeds the cost 

of training by the firm, the firm Is better off taking the most highly 

trained applicant available. 

However, problems with recent hires haye led employers to downplay 

specialized training and emphasize the Impartance of basic skills and 

attitudes^ A 1978 study of hiring practices in New York City, for example, 

found that the primary concern of employers' for hiring In entry*level 

Jobs was now reading and writing skills. When we asked employers what 

they want now from a vocational training system* they Indicated a willing** 

ness to provide specialized training on their own* as long as schools 

are provI<iIng the basics and Inculcating motivation and a work ethic. 

As Robert Craig, spokesman for the American Society for Training and 

Development pointed out. Industry wants employees to know how to learn 

and they will take It from there. 

Industry wants new einployees to have solid abi 1 1 rles-rl nterpersonal 
skills, communication skills and broad mathematics for business 
training, .for example. Educators can leave the Job-speclfic training 
to employers. 

One large ^^rnployer was willing to set priorites for applicant 
qutillflcatlons as well. He says he wants employees with six months of 
actual experience In the field. Absent that, however, he wants: first, 
good motivation* reliability and cousclentiousness; and second, basic 
reasoning skills, some math skills and mechanical aptitude. I.e. ''train*' 
ability." He claims special Ized ski I Is are less significant because 
most of what's out ther is not quite right for his firm In any case. 

'Educators and the general pub! c are also Increasingly worried about 
a decline In test scores, such as SAT scores, and additional strong 
pressures have been put on the public school system for a return to the 
**baslcs.** Similarly* the public has been alerted to the particular problems 
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and poor educational preparaticn of disadvantaged youth* Such concerns 

have led to the recent Carter Administration proposal^ for exanple^ that 

two billion dollars pf federal funds be funneled Into disadvantaged-area 

school districts to Improve schooK and keep teenagers in school through 

subsidized WQrk*study programs* 

There Is also a recommendation from researchers such as Wellford Wilms 

that the vocational preparation of youth be redirected to the basics and 

to work attitudes and away frofn specialized skills* As he wrote In a 

paper prepared for a Workshop on Policies Affecting Vocational Education 

at the Aspen Institute In August ^ .1979.: 

We conclude that public vocational education should shlf. Its focus 
from narrow skill training^ to In^rovlng students* abilities to 
read^ wrlte^ cor[q>ute^ solve problems^ and express themselves by 
becoming more integrated with academic education particularly at 
the high school level. We conclude also that to the greatest extent 
possfble^ public vocational education should combine work experiences 
with academic educa^tton to aid In career guidance and the develop* 
ment of 'industrial discipline* at both the secondary and post^ 
secondary levels. 50 

U Is not yet clear what form the response of public schools will take. 
On the face of It^ the new focus on basics would seem to Indicate a' 
return of vocational students from shop to ^classes tn English and tndth. 
However^ ^he experiences of proprietary schools suggest that training In 
basic skills^ specialized skills and motivation are closely Intertwined. 
Hotlvatlon can be raised and work reliability Increased through short 
Instructional units and attention to attendance^ dress and other work 
habits during the course of a specialized skill program. Similarly^ 
proprietary schools have found that students vrho have been failures In 
school tn the past are not receptive to reading and mathematics instruction. 
Their Interest and cofwiltment are elicited only by developing their 




confidence first in specialized^ Job-related sklits^ and then by indirectly 

convincing them of the importance of basic skills for more advanced work*^^ 

It may be necessary in public school programs as welK to approach 

education In basic ski Us .and work habi ts via specialized ski It training 

and exposure to the work place* )n other words^ the direct focus of the 

curriculum might stIU remain on career skHls^ but the methods of instruc* 

tion would be altered to elicit student Interest and commitment^ and 

InHirect]y to Increase exposure to basic sklUs* An experimental program 

In t^e 1960*s at the Richmond School In CaUfbrnta is an exan^te of such 

efforts to teach abstract concepts to under*achlevers through practical 

application* As Wilms recounts^ "Children learned English^ physics^ 

drafting and algebra through mechanisms that Interest teenagers such as 
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internal combustion engines and photography*"'^ Wilms also ts convinced 

that cooperative education programs are successful examples for pubMc 

schools to follow in the future: 

, Our review of cooperative education programs that integt*ate work 
experience and study offers persuasive evidence that :>tuc}ents' 
development and career guidance can be improved dramatically through 
carefully designed experiences that foster an increase in their 
sense of competence and control over thj^Ir own lives* Evidence 
is emerging from evaluations of the Experience Based Career Educa* 
tion model that integrates work experience and academics^ showing 
students in these programs increase their self*dIrection and confi- 
dence and Improve their ability to effectively communicate with 
adults*53 

Standardization of Certificates 

In the face of mass confusion over school and program certificates 
and licenses^ x'oluntary professional associations have begun to develop 
national standardized tests for certification in their fields* ln what 
has been terned a "surge of activity" in the last five years, exams have 
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been developed for pesticide applicators^ medical laboratory personnel^ 
data*processlng specialists^ court reporters^ constructlon**code Inspec* 
tors and other professions* 

The potential for a standardized certificate to reduce the' uncertainty 
In hiring by employers and be of vaiue to* Individual students Is great* 

Nancy Rubin In a recent New York Times article describes the Intact of 

/ 

a new auto mechanics certificate on hiring: 

When Albert Codi needed a new mechanic for hts White Plains service 
station three years ago» he Interviewed several young men* All 
were well-qualified^ but Hr* CodI chose Danny Smallen^ a 23**year- 
old mechanic certified by the National Institute for Automotive 
Service Excellence (N*I*A*S.E*) 'The fact that Danny had passed 
- the examination was a key factor In my selection^* recalled Hr* Codt* 
^It^'s not that the other applicants weren^t good^ but since Danny 
was certified^ I was more assured of his competence* 

As the quote Indlxates^ the other applicants appear to be wetHqual I fled* 

'^But the test has reduced the uncertainty In hiring; Hr. CodI was 'W>re 

assured" of Danny's competence than of ^he others* 

A second movement has been the design of national standardized 

licensing exams to replace the diversity of cests developed by each state 

on Its own* The new exams Bre being developed for voluntary occupational 

associations by professional testing companies such^s the Educational 

Testing Service and the American College Testing program In such fields 

as real estate* Insurance and social work* Rubin cites the following 

example of social work licensing tests and the motivation for Itt 

' The standardized tests^ which are being used by only three of the 
23. states that now require socla1*work licenses^ is wh;>c the assocl^ 

' ate director of the National Association of Social Workers* Leonard 
Stern* hopes will result In a uniformity of standards and reclpro* 
city of licenses. 

***Acknowtedglng that socIal*-work specialties have grown haphazardly^ 
Hr* Stern satd that the National Association of Social Workers 
was engaged In a study to determine appropriate areas of SffecIalW 
zatlon and certification for Its 80^000 members*55 
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V One charge made by analysts cf the llcenstng process Is that these 

'A 

^: tests are designed and Implemented by professionals to restrict entry 

y 

Mnto the field and keep earnings high. ThQ> fastest growing area of 
f Increasing specialization In rerant years has been in allied health oc** 
p^ciipatlons. As Or. WIniium Wal lace. Vice President of the Psychological 
I Corporation, states, •'...much of the effort comes from a sincere attempt 

( ;to set standards and define the field." However, Paul Pottinger of the 

K " ' 

t National Center for the Study of the Professions has called these recent 

I devel<»pments *'credentlai Inflation." Says Pottlnger: 

As the country becomes nore of a human^servlce provider than a 
goods producer, the occupations ,^and partTcularly, the h«alth pro* 
fessions, are trying to extabllsh a pecking order.. Medicare, 
Medicaid and the likelihood of national health Insurance make this 
exactly the right time for people to draw up their lines of turf.56 

Finally, the National Commissidn for Health Certifying Agencies 
was established In 1978 to monitor the proliferation of associations 
: in the Malth care field itself. If an agency wants to be an ^proved 
certifier of :lental assistants, it must show the Commission that it 
meets certain standards, e.c^. It is independent of its advocacy assocla* 
tion. It has conducted a Job task analysis that outlines the skills 
required In an occupation, i>nd it Is^uslng measures that test for the ski 
outlined In the job analysis.^? The Commlssion*s efforts should help to 
reduce the confusion in the field of health certification end increase 
the vali<)Ity of the certificates as measures of job perforrance. The 
geographic mobility of graduates who are certified V -.he Commission's 
certified agencies may also be enhanced. 
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jtesearch on PredTctlve Validity and OevelopTOnt of New Tests * 
Minority groiq>5 and researchers have , Increased the awareness of 
employers, government and educational Institutions alike that many 
r existing t€^ts discriminate unnecessarily against blacks* As a hedge 

\»galnst legal sutts» emptoyer^have cut back on what had been fairly 

\ 

routine use of written tests of applicants^ the federal government has 
' established equal-opportunity guidelines In response to Title VII of the 
Ctyll Rights Act of ,19&4 (which requires that Job-selection procedures^ 
Including licensing and certification exams bfe nondJscrlmlrtatory), and 
>>i^^ local governments have been forced by local groups to redesign tests 
firefighters, police and other civil service jobs* 
Such pressure on employers and on government ,to be nondiscrimlna- 
f* tory^^long with demands from eraployers^for measures of competence In 

basic skills and attitudes, have led to a number of efforts In the 
i research and test development community to develop unbiased, vall^and 
relevant test\of coinpetence* These efforts have a variety of purposes 



and backgrounds, .but they are unified by a commitment to Improve the 



quality of skill documentation for the workplace* 



Jf/' In the Army's Training Support Center work has been underway for 
If: several years to develop a whole new set of skill qualification tjsts" 
§iwrltten and performance* These tests will measure the skills needed In- 
I the field much more closely than the prior tests, which were primarily 
\f used In persmnel decisions* the skill qualification tests (sQT's) are 



an Integral part the apgradlngxof Army training* Notices of the re- 
quirements for SQT's are given to soldiers six months In advance to 



L **mbtlvate and direct the teaming of those to be tested"* 
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ln the area of certtficatton testing there are a nunfcer of efforts 
that should !niprove the validity and overall quajlty of cArtlftcatlon 
tests as measures of Job performance* The National Occupational Competency 
Testing Institute (HOCTl) has developed written and performance tests 
to measure the ability of skilled tradesmen who wish to become vocational 
instructors* These tests are being tested now for use tn measuring student 
abilities* ^ The Clearinghouse for Applied Performance Testing (CAPT) 
c6TtectS» disseminates and evaluates the quality of many performance 
tests of occupational skills* " . 

In the professions, the Educational Testing Service has been Involved 
in testing validation for social workers* lawyers dnd nursing speclall&ts*^^ 

It has also developed the ^validation for thp auto mechanic's certification 

* 62 
discussed earlier* ^ 

In Canada^ research Is underway to develop measur'es for ''generic 
skills*" These are behaviors which are .fundamental to tasks that are 
carried out In a wide range of occupations* ^ They could include academic 
skills such as multiplication* reasoning skills such as diagnosing viork 
problems* manipulation skills such as hand/eye coordination* and Inter* 
Personal skills such as giving rewards or discipline* These measures 
could be used to overcome the problem of an overemphasis on specialized 
skills* These measures have been used In curriculum development in 
Canadian government training progtrams* Similar work Is only at the early 
research*and development stage in this country*^'* 

Within manpower training programs* Or* Norman Freeberg has developed 
^ battery of measures to assess the outcome of work training programs* 
particularly the Neighborhood Youth Corps and Opportunities Industrialization 



Center's programs* ^These tools Include m^sures. of vocational self* 
confldence attitudes toward supervlslon^^^and job finding abtllty* These 
measures have been evaluated as predictor^ of labor market success In 



getting aOob and Mgher eamVngs* ^ Sbch measures could be developed 



further to j^rovide u&efyl measures of employabi llty beyond specialized 
New Tools to Doc ument Competence 

^ * ^ 

In addition to- the attempts to improve the quality ot tests of 

* competence^ a number of efforts are underway to Improve the quality of 
the document""the certificate of skill record"that a worker carries 
through life, ' ' 

The American Council on Sducation Is working with the Anny tol 
develop a comprehensive reporting and record system which tracks the 
Serviceman's skill development and academic credentials throughout his 
military career* The Council Is also examining military occupational 
specialties" (HOS's^ to see what college credUs can be gk^^for HCJS 
tralnlng*^^ These efforts shouTd provide a serviceman with a more ^etilled 

.record of his accomplishment that will be more descliptlve than his 
HOS code* Thoy should also improve his mobility Into the civilian work 
of work If he leaves the service* 

At the Center for the Study of the Profession* ^ v/ork Is underway 
to develop a document that will explain all the skills of comrmjnity mental 
heiilth workers* In the Office of Dconomic Opportunity programs of the 

^sixtieSy community workers developed counseling and other service delivery 
skills through tfi^Ir wrk experience. Now the Center, is develop^ing mea-* 
sures such as written tests and simulations that carf^document these skills^ 

^ . 1 ' ■ • : 

53 ' 



(Sartlcularly the Interpersonal^skl lis* The Indly'tduaPs performance on - 
a variety of tests would be Included and the underlying test Instrument 

* * 

would be explained In a composite reco^ that goes ^to the erpployer* A 
one page skill matrlxwit^ explanatory backup Information Is one form the 
document may take* A nidjor erpphasls here Is for the development k f ' * 

national measurement Instruments*^ " 

^ * 

' In a similar vein, the National Institute on Drug Abuse ^Is developing 

tools to measure the skills of drug abuse counse^r^. Here the challenge 

^arises from the need to certify competent service delivers in a field in 

which Interpersonal relations are very important* The approach b^Ing used 

4 ^ 

IS portfolio development. The individual Is to explain what skills he 

holds and the evidence of» and level of» his competency*" Th« pusji here 

* f 

Is for national guidelines for documentation-*for example the guideline 
would say that skill X^should be documented by performance rather than 
written tests !rt all states* National tests would not be required* 
tiowever^ the tests and the skllt documented must be among the most appro- 
priate indicators of job performance avaMable*^? ^ 

In the last two cases» the work can tackle the problem of certificates 
that are overfocused on one quantifiable specialized ski^l by developing 
a fuller description Of sklM-s* By doQutnentlnt, the variety c^f skills and 
the skill level acquired^ It can avoid being a blunt» all^r^nothlng measure 
of competency* In the case of moblUty, the mental health worker certifi- 
erfle will probabjy be less confining because of its national measurement 
Ins^truments*^ Although the drug abuse counselor scheme can carefully 
document a variety of ski I Is » mobi lUy problems may still exist because 
dl^fferent states carry different requirements* 
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In CETA training programs , the Springfield^ Massachusetts skil! 
training program provides each graduate with^a detailed sunfnary of speci- 
fic skills which have been covered In the training* It includes a check* 
list of specialized sl:i lis topics such as taper turning or boring (machining 
operations) and basic skills topics like math^tics operations—powers, 
roots and laws of sine and cosine* ThiJt reporting makes clear exactly 
what the individpat f^as been exposed to and completed projects in* Such 
a report goes iruch farther than a statement of completion of a course in 
machine operations* 

Together all of these efforts to improve certification and occupa- 
tional coinpetency documentation should make some inroads into the testing 
and certification problems outlined earlier* However^ these efforts 
must be utilized by certifying agencies and schools or they will remain 
ivory tower exercises* 

The Politics of Reform 

Recent developments in certification and competency testing vjould 
appear to have the potential to inCreas^^ and improve the use of vocational 
certificates In the labor market and as a byproduct^ act as a stimulus 
to reform in the training system ^tself* Two political and legal debates^ 
however^ will continue to shape jIxk unknown ways the form these efforts 
will take In^ the future* 

Th^ first issue concerns the question of who designs the certificates 
or tests* Are they instituted at the national^ state or local level? Are 
they developed by government agencies or voluntary professional assocra* 
tions? On the face of it^ there are a number of arguments for the develop* 
ment of certificates to be centralized: visibility^ cost and feasibility^ 
and objectivity^ 

Ktr 
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Tht Importance of high visibility and clarity of the certificate 
feas been pointed out Many times In this study* If employers know the 
certificate^ its value will be enhanced for the student* Further^ In the 
literature review and in discussions with empioyers» vocational associa^ 
tions and researchers the few certificates that were distinguished as 
noteworthy^are all set by national organisations with national standards* 
Exarnples cited were: the Natiwai Institute for Automotive Excellence 
(KIASE) itfhich certifies auto and trucic mechanics; the American Medical 
Record Association which certifies medical record technicians; and the 
Federal Aviation Administration (FAA) which certifies aircraft mechanics* 

A second concern indicating centralised development of certificates 
is cost and feasibility* Quality t3st development is very expensive and 
time-consuming. ETS has estimated that each component of the^NIASE auto 
mechanics test» for example^ cost at least $20»000 to develop^^^ The 
American_Qvilege Testing prc^gram has over the last five years received 
seventeen contracts for vocational and professional examinations costing 
$800»000 or an average of $47»059 per test developed*^^ 

Host individual schools or school districts do not have the resources 

to fund these efforts* But without this level of commitment and expertise^ 

the tests are llicely to have serious problems. In a review of local 

testing practices \h Oregon following state legislation requiring com*^ 

petency assessment^ J*R* Norton found 'Macic of unifo/mity» test instruments 

which ia some cases d^ not closely match objectives and bad psychometric 

practices. "70 \ ' 

Finall/y if new certification schemes are to have much Impact on 

♦ * 
training instl tutions» they need to be developed by separate^ objective 

agencies without a staice in continuing with traditional practices. In 



\ 
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the case of state licensing examinations or professional certif icates» 
they need to l>e developed by boards with some Independence from workers 
in the field* Ttie well-resp^?cted auto mechanics and FAA certificates, 
for example, were both developed by agencies or associations other than 
the professional workers Involved* In the case of local schools, they 
may need to developed by county or state boards in order to assure 
objectivity* 

It IS preicisely the impact of new certificates on existing institu- 
tions that creates political difficulties* To the extent that certtfi* 
cation becomes a powerful lever on schools and programs, it can arouse 
their resistance* The experiences wi.th competency testing in public 
schools are suggestive of this conflict between local and certralfzed 
control. State testing is a device where, by design or otherv/ise, a 
measure of control over the curriculum is transferred from local school 
boards to the state department of education* For example, Hadaus and 
HcDonagh have found that teachers in New York have come to disregard 
objectives from local curriculum guides in favor of those tested in 
the Regents' Examina^^tions*?^ 

Local administrators, of course, resent the intrusion of state 

standard'setting; The public appears to ^nt it both ways* Polls show 

preferences both to maintain local contro over ^schools and to develop 

state standards and testing inftruments* According to Hadaus and HcDonag:i 

TeS'tIng companies unwittingly become accessories ^^efore and after 
the fact In this shift of power* * *Testing companies, and tests*- 
rather than the unart icu^ated issues of state control and Inter- 
district accountability — become the target of vitrioUc criticism*72 

The second Issue at stake In the politics of reform concerns the use 
In any form of written or performance tests In admissions and employment 

O I 



In the face of increasing debate over their potential bias and misuse 
to restrict access to jobs and schools* Ralph Nader recently released 
a we1i-*pub1{cized critique of the SAT exams as Invalid measures which 
unfairly exclude talented youth from attending the colleges of their 
choice* Tunkel and Klein have shown that written tests of specialized 
skills discriminate against blacks* Conferences^ proposals for national 
research efforts and editorial columnists .continue the debates over uses 
and abuses of tests* 

Hov/ testing and certification will weather the storm Is uncertain* 
If these critiques lead to the development of unbiased and valid tests 
which assess comptttence for the job^ everyone should support them^ 
including minorities. In the meantime^ however^ employers have cut back 
on the use of tests or have used instruments with eastly^quantlfted 
measures* Such defensive reactions will not help the minority or 
economically disadvantaged applicant who needs objective evidence of 
competence to overcome the stereotypes of his/her race or cla^s* 
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SECTION B 



APPLYING THE LESSONS OF CERTIFICATION 
TO CETA 



1. Problems In the CETA System 



While Comi>rehensIve Employment and Training Act (CETA) training pro- 
grams have in recent years reached large nurrbers of disadvantaged indi- 
viduals^ there is^ nevertheless^ concern that programs have not achieved 
their„€ull--poterttial* A goal of the program is to help the structurally 
unemployed overcome their handicap in the labor market by providing two 
important services: one» the job skills that they have not received and 
cannot afford ^he postsecondary levels and two» the coata^tsn^^h local 

employers that they would not otherwise make through friends^ relatives^ 
and other *f i rms* 

However^ empirical evidence suggests that» by and large* CETA pro* 
grams are not succeeding in this regard. Several recent studies suggest 
that* while graduates of CETA programs may have an Initial wage advantage 
over control groups of non^graduates* this wage advantage declines sub- 
stantially within several years time, A study by Cooley* HcGuire and 
Prescott* for example* found that manpower training programs can Increase 
the earnings of participants by $220 to $620 In the first year after 
training* However* the Impact drops off In later years to less than 
$100*^ One reason may be that most placements are in lanF-sklll jobs 
viith high turnover* not in Jobs utilizing skills or having potential 
fo^r advancement* 

A major problem for CETA is its poor reputation in the eyes of most 

employers* As Patricia Pannell summarized* in a recent paper for NIE: 

Business* In general* views government-sponsored programs more as 
an aid to the disadvantaged than as an efficient mechanism for 
training* As such they tend not to tdke manpower programs as a 
serious source of their labor supply** 




The problem appears to have two aspects; one» most employers do 
not actually hire CETA graduates and have no opportunity for the general 
impression of disadvantaged youth to be overturned^ and two» when em* 
ploycrs do hfre CETA graduates* they often discover serious problems of 
poor work habits and low basic skills* ^A U*S. Chamber of Cofnmerce sur* 
vey of 2»JSi00 personnel directors found that only 26,% had^used CETA, and only^ 
13% had used It as a continuous hiring source. Of those who had'hired 
CETA graduates* most had placed them in primary clerical and unskilli^d 
blue*col1ar occupations*^ 

A survey of 284 Boston*area employers in 1978 revealed a similar 
pattern;^ only 27» or less than 10%, reported hiring CETA graduates* Of 
Seventeen firms contacted about the sources they, used to>iire keypunch 
operators* five had used CETA graduates and had generally been satis^ 
fiedwith their performance* The survey stated that: "Of the remaining 
twelve firms* however* the vast majority either had never had any prior 
contact with federally-funded training programs (but were unaware of their 
existence) or surprisingly had never heard of CETA employment and training 
programs*'^ Four firms were interviewed about recruitment of legal secre^ 

tartes/y only a public defender law fl^rm had utilized CETA sources* The 

if 

attitudes of the other three were summarized as follows: 

Host firms felt that CETA trainees would not possess the proper 
work attitudes or the basic writing and grammar skills which they 
required of legal secretaries. In the majority of cases* however* 
this opinion was based upon conjecture rather than upon actual ex^ 
perience*^ 

Employers who do hire CETA graduates also have problems with job 
performance. The Chamber of Commerce study concluded that most employers 
were "generally satisfied**' but that a significant proportion had serious 
problems with "erratic attendance* poor motivation* low job performance* 
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unqualified referrals^ and excessive red tape*'*^ The Boston'^area survey 
also uncovered dlssatlsfactt on wl th 9^^^^^^^^ because of the I r d^f i cli^n^ 
cles in the "basics" of rea^ing^j^J tjjig^an^^ Only sixteen 

of the twenty-seven firms that hired CETA graduates claim to have had 
positive experiences*? 

The Visible Prpbl^eng 

What factors account for the poor reputation of the CETA program? 
The folia ing answers have been discussed in the interviews for this 
study with Department of Labor officials^ CETA off tcials> and employers: 
One> cl ientele of CETA * Many officials and employers feel that the 
typical CETA enrollee is so disadvantaged in educational and family back- 
ground^ that the necessary basic and specialized skills and the work 
habits needed for employment cannot be learned In the few months to a 
year that he/she is in the program* « 

' Twot Uck of direction and motivation on the part of the students * 
In many cases» CETA enrollees are not being pro^'* Hed ^ith clear objectives 
and plans for training* As a result^ they do not know how to and do hot 
have the motivation to focus their attentiCi on specific skill development* 
For example^ if attendance records are not kept> the student may not 
understand that this is an important work habit which employers require* 

Three > mismatches of CETA training programs and employers' needs * 

* 

Several criticisms are expressed in large-scale surveys such as the Cham- 
ber of Commerce study about the low quality of and non-responsiveness to 
employers' needs of CETA programs* The, concerns range from concern with 
the lack of preparat1/)n of CETA graduates in baste skills and their poor 

work habits to concerns about training In the wrong specialized skills 

* 

for' the local labor market* 
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Four> lack of placement services* A major handicap for dlsadvan** 
taged yputh U the lack of informal contacts with employers that m.rddl« 
class youths have through friends and relatives* A general perception 
is that CETA programs have not succeeded In developing eith«4: a) con- , 
tacts with several large employers tn a local area for training and direct 
placement of enroUees In the specific skills needed* or b) general 
placement offices with niany contacts with local employers and a persona** 
llzed placement effort for each graduate* The absence of such services 
Is a particularly acute problem when the reputation of CETA Is so poor 
and gene>al contact with the program so infrequent* 
Underlying Causes 

An important question is» why» if employers 'an4 others *have IdentW 

fled these problems^ they developed in the first Instance and now persist* 

CETA is a highly decentralized system of some k60 prime sponsors with 

several thousands of contracted units for training and work* These 

prime sponsors range frcwn the most rural to the most urban areas of the 

country, as well as the-most prosperous and the most severely distressed* 

* 

This decentraUzed system has the structure to nieet the needs of local 

labor markets^ but In many cases' the capacity for good service delivery 

has not been developed* There are very different track records for the 

« 

quality of training^ the extent of placements into unsubsidlzed employment^ 

and the qualtty of management* In looking at the variety of explanations 

* 

for CETA problems* It Is ttnportant to remember that all of these problems 
and explanations will not fit all prime sponsors* As In the proprietary 
school and public school sectors described in Section A» there is a wide 
range of qualTty and effectiveness in sys tems- where local Initiative is of 
paramount Importance and responsibility is decentralized* Any suggested 
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soluttons to these problems should not penalize those pr*m£ sponsors 
who'have already had o solid record of accomplishment* 

With this caveat In mind* the following explanations have been dis** 
cussed during the course of this study for problems In the CETA system: 

One> mis-'dl rected Incentives on CETA prime sponsors^* Because of 
current funding procedures, prime sponsors are assessed on the basis of 
enrollments and placements* Prime sponsors may* therefore* retain students 
for longer perlods^f^'tlme than necessary to keep enrollments high and 
pay more attention to placing the large numbers of graduates In jobs than 
In maximizing the quality of jobs found for graduates. Thts ortentatton 
of the prime sponsors, along with the low reputation of CETA In the eyes 
of employers, would explain the general finding that mny CETA graduates 
are placed in clerical and unski 1 led jobs with minimal potenJtlal for ad* 
vancement. 

Two, weak mechanisms of accountability * Within the CETA system, the 
pressures for accountability of the prime sponsor are weak* On the one ^ 
hand, the quality of training and the success of* the program are hard 
to evaluate* Prime sponsors may lack the procedures to monitor how well 
they are meeting their own objectives* As is evidenced by current discus- 
sions, there is confusion oyer baste objectives, as well as over the tech- ^ 
nlques and programs that can be developed to achieve them* CETA is a 
relatively new system without a fully-developed set of standards and ex- 
pertise, and prime sponsors are not fully aware of all the issues and methods. 

On the other hand, none of the other participants in the system, the 
student* the employeri or the federal governmenti has Both the Incentives 
and the means to enforce accountability on the prime sponsor. The student 
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has no market power to take his purchasing elsewhere; CETA is the pro- 
gram of last resort for disadvantaged youth* Employers may complain about 
the quality of training In the program^ but have evidenced minimal Involve* 
ment In the design and oversight of local efforts* Employers may have no 
real Incentive to do so* Statistics show that in some areas, the twenty- 
five percent of young people who drop out of high schoo) , are now compet- 
ing for nine percent of the available jobs* , Even In skilled areas, the 
sources of manpower may exceed the available number of Jobs* Complaints 
by employers^ about real shortages In high-technology areas have often hot been 
verified, nor evidence provided that if youth are trained In these skills, 
they wMI be hired. 

Finally, the federal governnwnt has ineffective sanctions on a sys- 
tem such as CETA which is designed to capitalize on the strengths of de- 
centralization and diversity* Existing sanctions for poor performance are 
* 

too extreme to be meaningful* Between the status quo and takeover of spon-_ 
sorship there are few effective gradations of control* As CETA has been 
Implemented over the last few years there has'also been a strong federal- 
local tension as to who is responsible for standard-setting, program 
development or performance monitoring* Efforts by theifederal government 
to Increase accountability on tl\e part of local prime sponsors may be 

seen In a political context as a threat to their autonomy and a rever- 

* 

slon to federal control* 

Recognizing these problems, the last round of CETA legislation autho- 
rized a demonstration PrUate Sector Initiatives Program (PStp). To be 
eligible for PSIP funds, each prime sponsor must establish ^ Private In- 
dustry Counctil (P(C) to approve the expenditure of PSIP dollars for public- 

private cooperative ventures* PtC's have^a good deal of leeway in the way 

* 
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they can spend their funds, and thpi- f««i 

™s, and their Influence may be substantial If they 

can address training standards dlrectlv Th- t 

directly. The private sector enthusiasm 

for tHU ve„tu„ ,s u„d.„,.s,e. S.t »„tH„ P,c ^et,„,s are „o suSsftute 
for th. da,-to-da, ,„te™, eva.uaf'on and revision of standards and 
Pr.,ra„s. The PS,P e»ort sHou.d co^.e^,. the d.ve.op^nt o, standard- 
settin, that cou.d .e developed through such processes as <C,„cafon 



" — ■•_ '■ercrrtcatton Pro cess 

The ,uest,on for th.s stud, has been the fol.ow.n,: what can a 
cert.f.cafon process p,a, ,n in^roving the labor ^rket success of CETA 
graduates, Section A su,,ests that certificates and tests. ,f approprl- 

-dent and fair .cha- 

n.s^ Of sortin, „or.er, into Job, ^ere their ccpetoncle, an. tralnin, 

are utUfzed, As a byproduct, thev stJmni.^ i " 

7f ociucc, they stimulate Investment In skills on 

the part of youth. To the extent that they replace traditional or cus- 
tomary en^loyer screens of race. se. and a.e by objective .asures of 

competence, they can facilitate the advancement «f ^ 

tne aavancement of .such groups In the 

labor market. FInatlv. cerfifi«n-,» l 

any. certification can be a mechanism for Increasing 

the quality and responsiveness of tralnlrtg programs. 
Certification .in CETA'can potentially: 

-give the employer a track record of what thp rcxA 
can do so he/she can quickly see If Iht '.Ia^ "TA graduate 
skills that are InporUt tl the j^- '"dividual holds 

-distinguish the better student from the crowd «f „ 

since the level of achievement is noted; graduates. 

CETA training and Its stand;,rHc v 
large numbers of employers l>v ^ltttnr, ll standards known to 
cation, rnonitorlng Thnerfo^L^cr!;^ standards for certlfl.- 
ketlng the certificates; " ^"'^ 
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— provide a clear signal to students of the objectives of the 
training program and the levftis of performance which they 
must attain to succeed* As a result^ both the notlvation 
and the achievement of CETA trainees should rise; 

"gfve Information to prime sponsors and the federal govermnent 
of the performance of Individual Instructors and of entire 
programs In training students to acceptable levels of per- 
formance* - If appropriate sanctions oxi poor performance are 
applied^ the rigor and standards of training should Increase; 

<\ 

-^function as a mechanism for ptfme i^nrvhsors^ employers and 
experts In^ratnlng and testing to discuss and develop respon- 
sive and hlgh-'quallty programs* in the process of developing 
certificates and tests, the Issues of concern taall can be 
raised and the current base of knowledge on trj^Inlng and testing 
can be researched* The results of these efforts wJM inform 
alt participants In the process and provide a signal to admin- 
istrator? and Instructors of the kinds and methovis of training 



Over ttme^ as standards are clarified and accountability enforced^ 
objective measures of competence (test scores, for example) should rise. 
As programs are redesigned in accord with employer standards^ and needs ' 
and new.practtces^ there would be an accompanying Improvement In the 
widespread perceptions of the program and better placements* and higher 
earnings for all CETAT graduates with a certificate* Objective measures 
of success of these efforts^ and an empirical test of their effective* 



ness^ would be: \ 

^-placement of superior graduates in skill^u jobs^ v/Ith good c^ 
for promotion^ 

— Improvement over time in test results and other measures of 
performance of trainees^ 



"higber expectations and better employer inff)ressIons of 
CETA programs^ and 

-**over a period of tir^e^ higher placement rates and earnings 
for the bulk of CETA graduates. 



needed . 
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(f certification were to supptemented by 'Innovations or revisions 
In prog/<tni^ or standard-setttng In C£TA» it would be hard to evaluate 
the Impact of each* For example^ tbe Private Sector Initiatives Program 
may* In different ways* lead to Improvement In these same measures of 
Success * . 



1 1 1 * Issues of Design and RecofTtfT>fendations 

Features of the Desian ^ ^- 

— ' ' ^ ^ 

In designing a certification process speclflcaUy for C£TA» the 

following features are Jtrportant: 

, "V/hat information is included in a certificate? 

* 

Possible measures are: 

completion/con^complbt ion of the program 
,wri tten^test results 
performance test results 

attendance reco.d /\ 
work attitude ratings -"^^^^^ 
basic ski 1 1 ratings i 
specific skill rattncjs 
recommendations from trainers 

"Who develops the certificate? 

Should th^ certificate be developed by each prtme^ sponsor? 
Should ^pVbtotypes be provided through a national effort? 
Should local. primes be required to use a national certifi- 
cate or allowed to substitute their own? 

— What else Is needed from prime sponsors to accompany the certt^ 
f icat ion ' process? 

Are new placement services a necessary complement to certifi- 
cation? Should the federal government require prime sponsors ' 
to reorient their training in prescribed directions, or encourage 
them to redesign their programs In response to the objective 
measures of Job competence reve^aled in a certification process?^ 
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— Hew are certificates tied to sanctions? ' 

Bow can the certificates be used by each prime sponsor to 
monitor. the effectiveness of instructors and programs? How 
will students who fail to meet the stanSarJs be handled? 
How can the federal government provide incentives for local 
pt'^m sponsors to Increase performance dnd placement of 
graduates? 

Factors in ttifi Design Decision - 

The research and interviews in Section A suggest answers to many 
of th/se questions* Several factors go into the decision on each; Wilt 
the Certificate be hlgh1y*cisible and clearly-known to eniployers? Is ^ 
^the ierttficate responsive to the information and skill needs and hiring 
prac|lces of employers? Does the certificate distinguishr the best 
students from the average? Does It-give the graduate geographi c mobi * 
Ti^^ Is the certificate nondiscriminatory? Is the certification process 
technically and politically feasible? Each of these issaes is discussed 
briefly below^ with implications for a new CETA program* 
Visibility and Clarity of the Certificate 

in Section A» we discussed the problems vfhlch^arlse frovn the multt* 
plicity and diversity of certificates Vn postsecondary training* An 
employer cannot come to know and trust' each and every one of the thousands 
of individual schools and certificates across the country, tn addition, 
the certificates themselvi^ seldom contain cle^T;^in format ion about the 
standards or tests Involved In the training* In the resulting confusion 
about what has been learned* ema^loyers often group vocational studeni 
into broad categories and fall to make the fine distlnct^^nT^^^tj^^e^ 
quality of training which would be warranted* l/ith A60 prEme sponsors 
(and maoy training programs under each) and widespread lack of^documen- 
tation of the trainees* records or the content oiF programs, a similar 
set of problems are present in hiring of CETA graduates. , * 



In thts confuston^ the need for stir^pUcity and clarity In selection 
of tests and design of the certificate is paramount. The number of nteasures 
or indicators of competence should be kept to a minimum, and those used 
should be the most concrete and least open to subjective Interpretation. 
FoH example, four or five competency n«asures can be better explained and 
marketed to employers than twenty^* An attendance record would also be 
fnore understandable -^cj'employers than a work attitude rating based'on 
subjective ratings of instructors* ^ 

A standardized national certificate formal] graduates In each speci- V 
fic occupa'tional field would be a highly-visible signal of job competence 
to employers* A CETA electronic technican in Massachusetts, would carry 
the, same credentials as one in Texas, and employers across the country 
woutd know this* A second approach, which may be pursued In tandem, 
is for local prime sponsors to develop specialized skill certificates 
for those employers who are willing to hire graduates and to spend the 
time in clarifying their particular needs and suggesting areas and methods 
of training* The disad^rantage o^ this option, however, and the reason 
why it should not be used exclusively, is that other employer's will be 
unable to assess the quality or relevance of a speclally-de&igned program 
and certificate and will discount its value In their hiring decisions. 

Responsiveness to Employers* Skill Requirements 

Research on vocational training graduates aro Interviews for this 
study suggest that employers took for three competencies in job applicants: 
good work habits; basic sicills; and specialized skills* When the certi- 
ficate indicates training ^nly in specialized skills, employers commonly 
call placeimnt offices and instructors in search of Information on atten* 
dance records and work habits* They also are beginning to develop their 
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own standardized tests of reading and mathematics competence to b. 
administered to Job applicants*^ 

The need for basic skiPs and good „o'rklng habits U particularly 
acute fcr CETA enrol lees: .n 1968. Ooerlnger „rpte: 

Unreliability on the Job tends to be a nore serious cause of 

In the 1979 survey of Boston-area firms, one employer felt that CETA 
training as now constituted was "a disservice to the Individual to shuf-. 
fie himAer Into programs without first providing basic reading and writing 



skills." 



Finally, the Chamber of Commerce su.'vey asked er,^loyers what would 
be useful programs for disadvantaged youth. Their responses, in rank 
order, were: 10 

General orientation/counselling on 
work discipline, attendance 



Basic literacy, arithmetic skills 
Skills training in the classroom 
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A variety of programs n,ust be dej/eloped and tested to deal with 
these problems and each prime sponsor[n«y approach them in a different 
way. In particular, .pecIaUzed ski ^ training wIlJ continue to be 
lmp6rtant when direct Hnks are n«de wWh an employer and a program is 
designed to „.et his/her specific needsV . Ho..ever, the CETA system should 
also be responsive to the development an\ certification of generic 
con,pe;tencies and work habits, the skills ^hich are broadly transferable 
fH one firm to another. Here, placement ^fforts should be directed 
at t|.ose large firms with low-skill entry-Uyel jobs and potential for 
Internal pro^tion and at small firms which d^ten provide the -bridge" 
for youth Jnto larger fUms. \ 

7Q\ 



Distinguishing Levels of Performance 

Host of. the certificates examined In this study Indicated completion 
of a program or passage of a test and nothing more. Because the documents 
carried^o gradations of acconipHshment — like grades or the actual stan- 
dardized te^ scores"the student is at the mercy of the employer's 
ge.ieral Impression of the school* The below average graduate of a high 
quality School benefits from this blanket treatment* but the above 
average student of a school with a poor reputation—as In the case of 
CETA — loses* No matter how well he or she can perform individual ly^ the 
program's stigma stands In the way of good employment. 

However^ some of the new efforts at detailed documentation of com- 
petency mentioned in Section A can distinguish the superior student from 
the mean and should'be examined as models for CETA certification: They 
can explain several dimensions of an Individual's performance. For example, 
if a student's manual dexterity is superior to SI'S cconitlve ability^ 
this distinction can be made by including both written end performance 
test scores, Sanples of records now being developed can be obtained 
from the Center for the Study of Professions, the National Institute of 
Drug Abuse* the Child Development Associate Consortium, tnc.^ the Medlx 
School in Baltimore and the Springfield* Massachusetts prime sponsor* 

Geographic Mobility 

National certificates wera cited frequently in our Purvey as particularly 

useful to employers* Their visibility gives therr* a stature seldom found 

in a locally developed^ locally used certificate. The trust and famlll- 

* 

drity engendered enhances the geographf c^mobr 1 i ty of those who the hold 
the certificates* Clearly, CETA certification can go either way--for 
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na^tlonal -certificates or for local prime sponsor certificates* While the 
local certificate may be developed and rnade known to a few employers in the 
local labor fTiarket, there Is no question that national certification can 
contribute to greatef mobility of the labor force. 
Non'Discrlmlnatlon 

If a certificate^ or any test underlying It* shows one group to have 
superior performance for reasons other than actual job competence^ the 
certificate Is discriminatory* Section A showed cases of such discrimination 
against minorities^ particularly In written tests* Several s^eps can minimize 
future bias* Flrst^ tests and certification documents should be tested and 
retested for thetr ability to fairly and accurately predict job performance. 
This argues for national test ^nd certification development because such 
research is most efficiently done in one or a few places. Second^ the 
certificate should include several measures so that discriminatory measures 
as yet undetected may be. offset &y d number of other tests* 

Political and Technical FeasIblM ty 

There are several areas of political and tt^ciinicat sensitivity in 
developing a certification process: one^ the resistance of local prime sponsors 
to more and inore costly federal mandates and require:nents; two^ reststaoce to 
national y government^funded tests in any segment of the decentralized 
educational system; three^ the skepticism of minority corronunitles about the 
development of tests used In hiring; and four^ the enormous costs of developino 
and perfecting tests and certificates. 

Local prime sponsors are currently over-burdened with the tasks assigned 
to them in CETA legislation and would resist and resent further program 
requirements or test devcloprnent requireinents from the federal government. 




The system as a whole would benefit from the development of skill records and 
tests and from more attention to basic skills and work habits. However, 
requirements on local prime sponsors to develop their own tests would pl?*ce 
demands for expertise and resources tnat could not be met without considerable 
strain. The costs of developing ona occupational skill test stsrt a^ $20,000. 
In that context, nationally-developed tests would be seen as facilitating 
and assisting prime sponsors in adopting standards, rather than burdening 
them with tasks they cannot easily perform themselves. 

Secondly, there is a widespread c!esire for CETA programs to do a better 
job at teaching disadvantaged youth both basic skfUs and good work habits. 
The development of tests and measures of these skills and attitudes, and 
thei requirement that they be given to enrollees is a less intrusive and 
possibly more effective means to encourage change than the establishment of 
new program requirements. The Department of Labor couid mandate primes to 
develop a sequence of programs of prescribed length, content and instructional 
method from basic skills and attendance records to specialized programs^ These 
requirertents would be contrary to the^ widespread support in the fiold for 
decentralization of program development. If program^ *^re implemented based 
on such national model, they might not work and local initiative and 
creativity would be thwarted. 

Test results, however, would provide an obvious measure of the 
performance of the prime sponsor In training students. As such, they would be 
^Vroduct** standards rather than **program'* standards for CETA. If continued 
funding were based on improvement in scores, primes would have the Incentive 
to change their programs In the desired directions, but the flexibility to 
do so in their own fashion. The political and programmatic advantages of 
decentralization would be preserved, but the incentives for performance would 



be Increased* 

The development of new certification tests or ImpIer,entatIon of 
existing tests In thj& CETA system would obviously be the subject ofUome 
concern and discussion to minority groups who are pushing hard for unbiased 
testing procedures* However, the argument can be made that good competency 
tests which clearly measure job-relevant characteristics will help 
disadvantaged youth get jobs to the extent that they replace the blanket 
poor impressions^ emp^loyers now have of minority youth* 

The fear5 of these groups that the competency tests will slrnply replace 

cne discriminatory screen with another witt beattayed If they are involved In 

« 

* 

the process of certification and test develotwnent at the national level* If 
local primes were left the Job of finding and developing their own battery of 
tests and skill records, the potential is great that they would use the 
biased tests of the past or unwittingly develop tests or records with all the 
problems which are now being recognized by researchers* The political 
Sensitivity of these Issues at the local level would be eaormous* 

For these reasons, the federal government should take the ^ead in 
developing the unbiased predictors of Job competence and skills* Substantial 
research projects could be supported to build upon recent efforts In the^se 
are^ and minority concerns could be easily and effectively incorporated In 
such programs and studied* Specialized skill tests can be gathered from the 
Educational Testing Service, the Center for Applied Performance Testing, and the 
National Oc.^upat lonal Competency Testing Institute for starters* There arc 
also collections of tests entitled Tests in Print and Me ntal Measurement 
Yearbook * Tests of work habits will be more difficult to find, but work 
is b£.lng done as described in Section A* 
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ftecQmmendations 

if skl'11 certification is to be a part of a scheme to tighten standards 

in the CETA system* we recommend that It include the fbt lowing: 

K Develop graduate skill records . These can be one--page documents that 
summarize a variety of student accompl ishinents in the training and 
the methods of instruction offered In the program* 

a* Include nteasures of competency tn basic skittsi work habits and 
spect a»i^ed skills* 

b* Keep the record simple. ^Avold clutter^jng It with many esoteric 
measures or extensive descriptions of programs. 

c. Avo!d the more subjective measures which leave much discretion 
to the tester/evaluator. 

. 

d. Require local prime sponsors to use national model skill 
records unless 'they have acceptable substitutes. 

2. Explore the use of national competency tests . 

a. Develop an inventory of specialized skill tests that can he 
used by prime sponsors as measures for the skill record. This 
inventory can begin with a collection of the numerous tests 
already In use for specialized skills. 

b. Develop tests or measures of v^rk habits and basic or generic 
skills that can then be used In the skill record as welt. 

, ^ c. Develop a range of scores In the tests to allow levels of 
performance to be distinguished. 

d. Set minimum national standards for passage of the tests and 

allow the prime sponsor to set higher standards for its students. 

3. Do extensive marketing of the C£TA standards and CETA grtaduates . 

a. Establish a full-time placement office with each prime sponsor to 
market both the certificates and the graduates to employers. 

.b. Externally market the standards and tests underlying the CETA 
certificate to employers on a nationwide basis. 

c. Bequire the placement office or instructors to discuss the 
standards and certificates with trainees so as to clarify goals 
and performance requirements for them. 
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APPENDIX A 
METHODbLOGTf 

The Department of Labor requeated research on the effectiveness of 

* * 

proprietary schools in preparing youth for vork*- The purpose of the study 

vould be to assiat the Department in consideration of a proposal for an 

entitlecent for certification of 'competencies for youth* The following 

questions were asked at lU^ oytset: ' 

— What proprietary school certificates have value in tKe 
labor market? 

»Vhat competencies appear to be associated with each of these, 
e*g*, discipline and work habits, basic skills, s'^ecialized 
skills? 

"What do employers say about th^ value and contributions 
of a proprietary school 'education? 

— What is the quality of tlje competency tests rof proprietary 
schools? What are the problems associated with such tests? 
Are they culture*biased? Do J:ests exi±£C for discipline and 
work habits? Would new ^cf^Ts^have to.be developed for the j 
DoL program? 

As the research evol/ed, the scope of the study was broadened to examine 
different types of occupational certification* ^ 

These questibns were explored with a' variety of experts* Discussions 
were held v±ph other researchers and developers in vocational education, 
certification and testing* The questions were also discussed with vocational 
school association presidents^ school directors and employers* The ^ 
lemployers* were large firms, often with their own traivixng or human resource 
development division* A complete. list of interviewees is included in ^ , 
Appendix B* . " 

The broader questions outlined above were asked of each group and these 
were accompanied by apecific queations appropriate for the particular group; 
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Where appropriate* certifying agencies and schools were asked what standards 

are used for passage^^and^^^^ these standards are developed* They w^.re also 

asked to provide copies of the tests and certifi^t~£^ requirements* Researchers 

and employers were asked what the strengths and weaknesses are in current 

certification schemes and what a TDodel certification program would look like* 

A thorough literature search was conducted as veil* The recent literature 

/ 

on the labor market experiences of postsecondary vocational school graduates 
was reviewed* Literature on occupational testing* employer attitudes* 
employment potential* employment qualifications and licensing* and 
certification practices were all explored* ^ 

In many. instances* the results of the search or the response of 
interviewees were disappointing* An employer may not have thought concretely 
about the role a certificate plays in hiring* The certifier may not have any 
means to test the value of his certifica^l^n^Jor_fij:ifiuly-'t^ worker in 
the occupationj^^^^t^jja^^^easler^TEo^'^^ information about failings in 
ce^txH^f^ioiT tl&an to get a direct sense of what a strong certificate should 
look like* Within these constraints* we analyzed the information we collected 
and extrapolated answer^; to our initial questions* alvays r^^alizing that 
this data may not take us as far as we would like to go* 
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\ 
\ 
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\ 

\ 
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*i 
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I 
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Rocco tasano^ Presl(Jent, Bay State Junior College 
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Craig Mu sick, Director of Training, Graniteville Co*, Graniteville, South 
Carolina 

Paul Pottinger, Center for the Study of the Professions 

Alexander Retell, , Placement Specialist, Katherine Gibbs School, Boston 

Rodney Rhoads, Manager of Employee Selection and Manageoent Development, 
Old Ben Coal Company, Benton, Illinois 

Benjamin Shimberg, Associate Director, Center for .Occupational and Professional 
Assessment, Educational Testing Service 

Strve Slater, Clearinghouse for Applied Performance Testing 
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, Education, Ohio State University 

Mary Sullivan, Director, Katherine Gibbs School, Boston 

Gref Sytch, General Technical Institute and Board of Directors of 
American Welding Society 

Mary Tenopyr, Manager of Employment Research and Systems, American Telephone 
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Jack Tolbert, President, The Bryman School; Past President, National 
Association of Trade and Technical Schools 

Laurence Vickery, Director, Employment Relations, General Motors Corporation 

Al Wiant, National Center for Research in Vocational and Technical Education 

Wellford Wi^*ni, University of California, Los Angeles^ 

C* R- "Pete" WiltiamS; Edurat^on Rirplnyp^ D^^'^l^pmei^t , IBh Ccrporaticr* 

Mary Wine, Director of Professional Relations, Association of Independent 
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